[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:55:51 dist-test-slave-7v06 krb5kdc[12761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:55:51 dist-test-slave-7v06 krb5kdc[12761](info): set up 2 sockets
Jun 20 14:55:51 dist-test-slave-7v06 krb5kdc[12761](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260620 14:55:52.749747 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:55:52 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:55:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:55:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:55:52.916932 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:46547
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:46547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:53.044009 12774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:53.044440 12774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:53.044500 12774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:53.047307 12774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:55:53.047418 12774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:53.047443 12774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:53.047466 12774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:55:53.047497 12774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:55:53.051059 12774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:46547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:46547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:53.051458 12774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:53.051752 12774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:53.059496 12780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.059612 12782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.059496 12779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:53.061908 12774 server_base.cc:1034] running on GCE node
I20260620 14:55:53.062336 12774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:53.062876 12774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:53.064133 12774 hybrid_clock.cc:648] HybridClock initialized: now 1781967353064110 us; error 73 us; skew 500 ppm
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:53.069511 12774 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:55:53.071741 12774 webserver.cc:460] Webserver started at http://127.12.116.190:45827/ using document root <none> and password file <none>
I20260620 14:55:53.072546 12774 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:53.072711 12774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:53.072932 12774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:53.077448 12774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "6a5e3ade698142ba83da805b16b0739b"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "3aecfa9621c84c757c83cd428826fa1d"
server_key_iv: "45a93b5d5e39673d8652fc467c903f7b"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.078127 12774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "6a5e3ade698142ba83da805b16b0739b"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "3aecfa9621c84c757c83cd428826fa1d"
server_key_iv: "45a93b5d5e39673d8652fc467c903f7b"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.080598 12774 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:55:53.082072 12789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.082327 12774 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:53.082442 12774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "6a5e3ade698142ba83da805b16b0739b"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "3aecfa9621c84c757c83cd428826fa1d"
server_key_iv: "45a93b5d5e39673d8652fc467c903f7b"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.082619 12774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:53.091814 12774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:53.097790 12774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:53.097949 12774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:53.102723 12774 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:46547
I20260620 14:55:53.102766 12841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:46547 every 8 connection(s)
I20260620 14:55:53.103175 12774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:55:53.104946 12842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:53.105291 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 12774
I20260620 14:55:53.105414 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:55:53.106181 12754 external_mini_cluster.cc:1428] Setting key 10c6d0bc0be2665f56a9e768a20cd037
I20260620 14:55:53.109351 12842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b: Bootstrap starting.
I20260620 14:55:53.110206 12842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:53.110620 12842 log.cc:824] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:53.111568 12842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b: No bootstrap required, opened a new log
I20260620 14:55:53.113969 12842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5e3ade698142ba83da805b16b0739b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46547 } }
I20260620 14:55:53.114212 12842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:53.114260 12842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a5e3ade698142ba83da805b16b0739b, State: Initialized, Role: FOLLOWER
I20260620 14:55:53.114470 12842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5e3ade698142ba83da805b16b0739b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46547 } }
I20260620 14:55:53.114581 12842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:55:53.114638 12842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:55:53.114697 12842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:53.115763 12842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5e3ade698142ba83da805b16b0739b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46547 } }
I20260620 14:55:53.115926 12842 leader_election.cc:302] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a5e3ade698142ba83da805b16b0739b; no voters:
I20260620 14:55:53.116180 12842 leader_election.cc:288] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:55:53.116205 12847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:53.116375 12847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [term 1 LEADER]: Becoming Leader. State: Replica: 6a5e3ade698142ba83da805b16b0739b, State: Running, Role: LEADER
I20260620 14:55:53.116480 12847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5e3ade698142ba83da805b16b0739b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46547 } }
I20260620 14:55:53.116529 12842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:55:53.118750 12848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a5e3ade698142ba83da805b16b0739b. Latest consensus state: current_term: 1 leader_uuid: "6a5e3ade698142ba83da805b16b0739b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5e3ade698142ba83da805b16b0739b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46547 } } }
I20260620 14:55:53.118897 12848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [sys.catalog]: This master's current role is: LEADER
I20260620 14:55:53.119014 12849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a5e3ade698142ba83da805b16b0739b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5e3ade698142ba83da805b16b0739b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46547 } } }
I20260620 14:55:53.119416 12849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b [sys.catalog]: This master's current role is: LEADER
W20260620 14:55:53.119751 12861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:55:53.119818 12861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:55:53.120852 12865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:55:53.121232 12865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:55:53.123934 12865 catalog_manager.cc:1347] Generated new cluster ID: 9b5c248241e0419684d236c0ab016d3a
I20260620 14:55:53.124039 12865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:53.138513 12865 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:55:53.140501 12865 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:55:53.143404 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.112242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44436 (local address 127.12.116.190:46547)
0620 14:55:53.112865 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:53.112880 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:53.112942 (+ 62us) server_negotiation.cc:407] Connection header received
0620 14:55:53.117175 (+ 4233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:53.117182 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:53.117253 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:53.117451 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:53.120416 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.121699 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.123778 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.124524 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.124729 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.138774 (+ 14045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:53.138780 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:53.138780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:53.138796 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:53.141006 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.141578 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.141597 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.141597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.141697 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.141996 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.141997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.141998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.142265 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:53.142473 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:53.142780 (+ 307us) server_negotiation.cc:299] Negotiation successful
0620 14:55:53.142952 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":310,"threads_started":1}
I20260620 14:55:53.158737 12865 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a5e3ade698142ba83da805b16b0739b: Generated new TSK 0
I20260620 14:55:53.159020 12865 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:55:53.199889 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46547
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:53.299046 12869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:53.299856 12869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:53.299949 12869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:53.302472 12869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:53.302587 12869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:53.302631 12869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:55:53.305334 12869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46547
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:53.305758 12869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:53.306313 12869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:53.313794 12874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.313794 12877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.314272 12875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:53.314332 12869 server_base.cc:1034] running on GCE node
I20260620 14:55:53.314548 12869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:53.314880 12869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:53.316270 12869 hybrid_clock.cc:648] HybridClock initialized: now 1781967353316230 us; error 60 us; skew 500 ppm
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:53.320762 12869 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:55:53.321556 12869 webserver.cc:460] Webserver started at http://127.12.116.129:41949/ using document root <none> and password file <none>
I20260620 14:55:53.321869 12869 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:53.321951 12869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:53.322117 12869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:53.323311 12869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "f105d9b295444e2eb3c5c8a45a61f581"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "a16ff403c2c891ce6809e016fe5a6c28"
server_key_iv: "84f473706c05f3c54d703ca0303c111d"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.323737 12869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "f105d9b295444e2eb3c5c8a45a61f581"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "a16ff403c2c891ce6809e016fe5a6c28"
server_key_iv: "84f473706c05f3c54d703ca0303c111d"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.325495 12869 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 14:55:53.326838 12884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.327340 12869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260620 14:55:53.327505 12869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "f105d9b295444e2eb3c5c8a45a61f581"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "a16ff403c2c891ce6809e016fe5a6c28"
server_key_iv: "84f473706c05f3c54d703ca0303c111d"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.327607 12869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:53.353025 12869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:53.356403 12869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:53.356776 12869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:53.357111 12869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:55:53.357955 12869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:53.358045 12869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.358088 12869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:53.358110 12869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.365388 12869 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:36427
I20260620 14:55:53.365566 12997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:36427 every 8 connection(s)
I20260620 14:55:53.365886 12869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:55:53.366919 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 12869
I20260620 14:55:53.367300 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:55:53.367494 12754 external_mini_cluster.cc:1428] Setting key 8b45de29e8e2bbe44223ca3cd4704602
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:55:53.382015 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.367427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:36283 (local address 127.12.116.190:46547)
0620 14:55:53.367508 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:53.367544 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:53.367846 (+ 302us) server_negotiation.cc:407] Connection header received
0620 14:55:53.368477 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:53.368478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:53.368493 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:53.368542 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:53.369758 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.370316 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.371886 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.372122 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.372364 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.375485 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:53.375490 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:53.375490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:53.375504 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:53.378361 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.379861 (+ 1500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.379862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.379863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.379940 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.380262 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.380264 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.380264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.380467 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:53.380548 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:53.381776 (+ 1228us) server_negotiation.cc:299] Negotiation successful
0620 14:55:53.381909 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260620 14:55:53.382659 13000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.367391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:46547 (local address 127.12.116.129:36283)
0620 14:55:53.367628 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:53.367697 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:53.368306 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:53.368641 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:53.368646 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:53.369320 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:53.369607 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:53.369616 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.370444 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.370445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:53.371731 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:53.371735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.372389 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.372391 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:53.372550 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.373213 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:53.373222 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:53.375339 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:53.378522 (+ 3183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:53.378541 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:53.378550 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:53.379693 (+ 1143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:53.380025 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:53.380026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:53.380027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:53.380170 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:53.380551 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:53.380559 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:53.381260 (+ 701us) client_negotiation.cc:769] Sending connection context
0620 14:55:53.381747 (+ 487us) client_negotiation.cc:240] Negotiation successful
0620 14:55:53.381980 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
I20260620 14:55:53.383505 12998 heartbeater.cc:347] Connected to a master server at 127.12.116.190:46547
I20260620 14:55:53.383657 12998 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:53.383873 12998 heartbeater.cc:511] Master 127.12.116.190:46547 requested a full tablet report, sending...
I20260620 14:55:53.384970 12806 ts_manager.cc:194] Registered new tserver with Master: f105d9b295444e2eb3c5c8a45a61f581 (127.12.116.129:36427)
I20260620 14:55:53.386372 12806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:36283
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:55:53.412662 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46547
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:53.511552 13003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:53.511863 13003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:53.511911 13003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:53.513441 13003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:53.513540 13003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:53.513592 13003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:55:53.515316 13003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46547
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:53.515655 13003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:53.515916 13003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:53.522266 13008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.522289 13009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:53.522375 13003 server_base.cc:1034] running on GCE node
W20260620 14:55:53.522249 13011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:53.522768 13003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:53.523028 13003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:53.524259 13003 hybrid_clock.cc:648] HybridClock initialized: now 1781967353524222 us; error 46 us; skew 500 ppm
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:53.527356 13003 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:55:53.527832 13003 webserver.cc:460] Webserver started at http://127.12.116.130:41679/ using document root <none> and password file <none>
I20260620 14:55:53.528087 13003 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:53.528169 13003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:53.528396 13003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:53.529567 13003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "8429df1fbc474464a0e03cfaa9f54e1c"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "148696ef719d638ed18e6e18e1750d0d"
server_key_iv: "7fcc0e1ea4262b178c163370a7dd9a9e"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.529963 13003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "8429df1fbc474464a0e03cfaa9f54e1c"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "148696ef719d638ed18e6e18e1750d0d"
server_key_iv: "7fcc0e1ea4262b178c163370a7dd9a9e"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.531710 13003 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260620 14:55:53.532735 13018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.532995 13003 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:53.533115 13003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "8429df1fbc474464a0e03cfaa9f54e1c"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "148696ef719d638ed18e6e18e1750d0d"
server_key_iv: "7fcc0e1ea4262b178c163370a7dd9a9e"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.533214 13003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:53.545567 13003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:53.548821 13003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:53.549024 13003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:53.549347 13003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:55:53.549726 13003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:53.549787 13003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.549835 13003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:53.549863 13003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.557116 13003 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:43541
I20260620 14:55:53.557153 13131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:43541 every 8 connection(s)
I20260620 14:55:53.557523 13003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:55:53.559484 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13003
I20260620 14:55:53.559612 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:55:53.559820 12754 external_mini_cluster.cc:1428] Setting key 3eacbcc55bb749a4fba44432cb5f2727
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:55:53.570561 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.558380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:53589 (local address 127.12.116.190:46547)
0620 14:55:53.558468 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:53.558471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:53.558681 (+ 210us) server_negotiation.cc:407] Connection header received
0620 14:55:53.559212 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:53.559213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:53.559224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:53.559295 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:53.560680 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.561439 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.562821 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.563169 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.563258 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.566323 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:53.566326 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:53.566326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:53.566338 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:53.568524 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.569106 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.569108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.569108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.569179 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.569499 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.569500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.569501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.569680 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:53.569753 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:53.570401 (+ 648us) server_negotiation.cc:299] Negotiation successful
0620 14:55:53.570487 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260620 14:55:53.570739 13134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.558322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:46547 (local address 127.12.116.130:53589)
0620 14:55:53.558505 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:53.558551 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:53.559083 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:53.559395 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:53.559399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:53.560211 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:53.560548 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:53.560555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.561577 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.561578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:53.562441 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:53.562443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.563316 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.563318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:53.563555 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.564292 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:53.564302 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:53.566149 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:53.568681 (+ 2532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:53.568690 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:53.568692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:53.569005 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:53.569292 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:53.569293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:53.569293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:53.569418 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:53.569799 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:53.569806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:53.570242 (+ 436us) client_negotiation.cc:769] Sending connection context
0620 14:55:53.570347 (+ 105us) client_negotiation.cc:240] Negotiation successful
0620 14:55:53.570502 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":106,"threads_started":1}
I20260620 14:55:53.571869 13132 heartbeater.cc:347] Connected to a master server at 127.12.116.190:46547
I20260620 14:55:53.572106 13132 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:53.572443 13132 heartbeater.cc:511] Master 127.12.116.190:46547 requested a full tablet report, sending...
I20260620 14:55:53.573849 12806 ts_manager.cc:194] Registered new tserver with Master: 8429df1fbc474464a0e03cfaa9f54e1c (127.12.116.130:43541)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
I20260620 14:55:53.574507 12806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:53589
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:55:53.597649 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46547
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:53.717729 13137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:53.718082 13137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:53.718132 13137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:53.720252 13137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:53.720360 13137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:53.720412 13137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:55:53.722432 13137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46547
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:53.722702 13137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:53.722913 13137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:53.728598 13142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.728591 13143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:53.728636 13145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:53.728758 13137 server_base.cc:1034] running on GCE node
I20260620 14:55:53.729133 13137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:53.729419 13137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:53.730618 13137 hybrid_clock.cc:648] HybridClock initialized: now 1781967353730605 us; error 44 us; skew 500 ppm
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:53.733884 13137 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:55:53.734432 13137 webserver.cc:460] Webserver started at http://127.12.116.131:44863/ using document root <none> and password file <none>
I20260620 14:55:53.734678 13137 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:53.734750 13137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:53.734902 13137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:53.736246 13137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "8e37966a9ee640db94b56db43b2b247f"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "bd07505a593c82664d1cb3f003e766fa"
server_key_iv: "7636692fddd1851b384bd67a3a8c20d6"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.736802 13137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "8e37966a9ee640db94b56db43b2b247f"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "bd07505a593c82664d1cb3f003e766fa"
server_key_iv: "7636692fddd1851b384bd67a3a8c20d6"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.738591 13137 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:55:53.739813 13152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.740123 13137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:53.740247 13137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "8e37966a9ee640db94b56db43b2b247f"
format_stamp: "Formatted at 2026-06-20 14:55:53 on dist-test-slave-7v06"
server_key: "bd07505a593c82664d1cb3f003e766fa"
server_key_iv: "7636692fddd1851b384bd67a3a8c20d6"
server_key_version: "encryptionkey@0"
I20260620 14:55:53.740381 13137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:53.752254 13137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:53.754940 13137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:53.755084 13137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:53.755296 13137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:55:53.755697 13137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:53.755734 13137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.755759 13137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:53.755805 13137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:53.763667 13137 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:34677
I20260620 14:55:53.763708 13265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:34677 every 8 connection(s)
I20260620 14:55:53.764086 13137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:55:53.764876 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13137
I20260620 14:55:53.765100 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:55:53.765326 12754 external_mini_cluster.cc:1428] Setting key 972d7a707316a84c673699da29cd4cd0
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:53.776840 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.765077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:46291 (local address 127.12.116.190:46547)
0620 14:55:53.765257 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:53.765259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:53.765902 (+ 643us) server_negotiation.cc:407] Connection header received
0620 14:55:53.767365 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:53.767367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:53.767380 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:53.767445 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:53.768798 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.769316 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.770503 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.770730 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.770794 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.773210 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:53.773212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:53.773212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:53.773220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:53.774960 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.775550 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.775551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.775552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.775620 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.775943 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.775945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.775945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.776089 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:53.776160 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:53.776681 (+ 521us) server_negotiation.cc:299] Negotiation successful
0620 14:55:53.776766 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260620 14:55:53.776999 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.765098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:46547 (local address 127.12.116.131:46291)
0620 14:55:53.765432 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:53.765581 (+ 149us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:53.767222 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:53.767590 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:53.767595 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:53.768379 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:53.768645 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:53.768651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.769533 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.769534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:53.770395 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:53.770398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.770822 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.770823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:53.770939 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.771583 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:53.771592 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:53.773108 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:53.775076 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:53.775085 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:53.775087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:53.775432 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:53.775727 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:53.775728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:53.775729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:53.775849 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:53.776231 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:53.776237 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:53.776466 (+ 229us) client_negotiation.cc:769] Sending connection context
0620 14:55:53.776613 (+ 147us) client_negotiation.cc:240] Negotiation successful
0620 14:55:53.776773 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":86,"threads_started":1}
I20260620 14:55:53.777711 13266 heartbeater.cc:347] Connected to a master server at 127.12.116.190:46547
I20260620 14:55:53.777954 13266 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:53.778347 13266 heartbeater.cc:511] Master 127.12.116.190:46547 requested a full tablet report, sending...
I20260620 14:55:53.779196 12806 ts_manager.cc:194] Registered new tserver with Master: 8e37966a9ee640db94b56db43b2b247f (127.12.116.131:34677)
I20260620 14:55:53.779665 12806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:46291
I20260620 14:55:53.791406 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:55:53.822976 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.811396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51462 (local address 127.12.116.129:36427)
0620 14:55:53.811688 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:53.811695 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:53.811723 (+ 28us) server_negotiation.cc:407] Connection header received
0620 14:55:53.811754 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:53.811756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:53.811773 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:53.811853 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:53.812565 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.813365 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.814221 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.814907 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.815293 (+ 386us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.818881 (+ 3588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:53.818896 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:53.818896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:53.818908 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:53.821252 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.821904 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.821909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.821910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.822002 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.822243 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.822244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.822245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.822436 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:53.822566 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:53.822778 (+ 212us) server_negotiation.cc:299] Negotiation successful
0620 14:55:53.822872 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":105,"threads_started":1}
W20260620 14:55:53.823423 12912 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51462
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:55:53.850024 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:53.841421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51472 (local address 127.12.116.129:36427)
0620 14:55:53.841514 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:53.841516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:53.841674 (+ 158us) server_negotiation.cc:407] Connection header received
0620 14:55:53.841743 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:53.841744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:53.841760 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:53.841833 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:53.842539 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.843063 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.843964 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:53.844246 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:53.844323 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:53.846930 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:53.846931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:53.846932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:53.846940 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:53.848463 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.848897 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.848898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.848898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.848956 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:53.849215 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:53.849216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:53.849217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:53.849521 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:53.849662 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:53.849854 (+ 192us) server_negotiation.cc:299] Negotiation successful
0620 14:55:53.849950 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260620 14:55:53.850732 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 12869
I20260620 14:55:53.855618 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13003
I20260620 14:55:53.861896 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13137
I20260620 14:55:53.866990 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 12774
2026-06-20T14:55:53Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2241 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[13280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[13280](info): set up 2 sockets
Jun 20 14:55:53 dist-test-slave-7v06 krb5kdc[13280](info): commencing operation
krb5kdc: starting...
W20260620 14:55:54.960987 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:55:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:55:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:55:55.104745 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37265
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:55.205510 13293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:55.205819 13293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:55.205845 13293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:55.207422 13293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:55:55.207510 13293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:55.207525 13293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:55.207540 13293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:55:55.207556 13293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:55:55.209494 13293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:55.209812 13293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:55.210094 13293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:55.215368 13298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.215373 13299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.215368 13301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:55.215811 13293 server_base.cc:1034] running on GCE node
I20260620 14:55:55.216041 13293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:55.216365 13293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:55.217558 13293 hybrid_clock.cc:648] HybridClock initialized: now 1781967355217545 us; error 42 us; skew 500 ppm
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:55.220611 13293 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:55:55.221215 13293 webserver.cc:460] Webserver started at http://127.12.116.190:44235/ using document root <none> and password file <none>
I20260620 14:55:55.221474 13293 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:55.221546 13293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:55.221699 13293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:55.222838 13293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "0f7cb13ce4a144c980d6297a644acc9d"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "7203293fcec12827ae6a652e17b4420c"
server_key_iv: "13539d9707cd4c723e283f4fe7aa594b"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.223233 13293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "0f7cb13ce4a144c980d6297a644acc9d"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "7203293fcec12827ae6a652e17b4420c"
server_key_iv: "13539d9707cd4c723e283f4fe7aa594b"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.225023 13293 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260620 14:55:55.226068 13308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.226441 13293 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:55.226594 13293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "0f7cb13ce4a144c980d6297a644acc9d"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "7203293fcec12827ae6a652e17b4420c"
server_key_iv: "13539d9707cd4c723e283f4fe7aa594b"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.226753 13293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:55.246187 13293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:55.250023 13293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:55.250267 13293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:55.255148 13293 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:37265
I20260620 14:55:55.255208 13360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:37265 every 8 connection(s)
I20260620 14:55:55.255636 13293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:55:55.256842 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:55.259361 13361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d: Bootstrap starting.
I20260620 14:55:55.260807 13361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:55.261121 13361 log.cc:824] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:55.261778 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13293
I20260620 14:55:55.261900 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:55:55.262094 12754 external_mini_cluster.cc:1428] Setting key 58290315e4eb020d84404f043d9e6826
I20260620 14:55:55.262445 13361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d: No bootstrap required, opened a new log
I20260620 14:55:55.265916 13361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7cb13ce4a144c980d6297a644acc9d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37265 } }
I20260620 14:55:55.266227 13361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:55.266287 13361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f7cb13ce4a144c980d6297a644acc9d, State: Initialized, Role: FOLLOWER
I20260620 14:55:55.266510 13361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7cb13ce4a144c980d6297a644acc9d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37265 } }
I20260620 14:55:55.266621 13361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:55:55.266664 13361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:55:55.266712 13361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:55.268146 13361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7cb13ce4a144c980d6297a644acc9d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37265 } }
I20260620 14:55:55.268374 13361 leader_election.cc:302] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f7cb13ce4a144c980d6297a644acc9d; no voters:
I20260620 14:55:55.268653 13361 leader_election.cc:288] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:55:55.268848 13367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:55.269023 13361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:55:55.269028 13367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [term 1 LEADER]: Becoming Leader. State: Replica: 0f7cb13ce4a144c980d6297a644acc9d, State: Running, Role: LEADER
I20260620 14:55:55.269248 13367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7cb13ce4a144c980d6297a644acc9d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37265 } }
I20260620 14:55:55.269665 13368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f7cb13ce4a144c980d6297a644acc9d. Latest consensus state: current_term: 1 leader_uuid: "0f7cb13ce4a144c980d6297a644acc9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7cb13ce4a144c980d6297a644acc9d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37265 } } }
I20260620 14:55:55.269773 13368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [sys.catalog]: This master's current role is: LEADER
I20260620 14:55:55.270274 13366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f7cb13ce4a144c980d6297a644acc9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7cb13ce4a144c980d6297a644acc9d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37265 } } }
I20260620 14:55:55.270380 13375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:55:55.271008 13375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:55:55.270457 13366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d [sys.catalog]: This master's current role is: LEADER
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:55.273780 13375 catalog_manager.cc:1347] Generated new cluster ID: 66d127c1607840079fdd2f207086414d
I20260620 14:55:55.273876 13375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:55:55.278653 13365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.262775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47402 (local address 127.12.116.190:37265)
0620 14:55:55.263154 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.263171 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.263247 (+ 76us) server_negotiation.cc:407] Connection header received
0620 14:55:55.264815 (+ 1568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.264831 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.264938 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.265204 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:55.265951 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.268234 (+ 2283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.269914 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.270652 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.270771 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.273996 (+ 3225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:55.274001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:55.274002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:55.274017 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:55.276181 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.276701 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.276706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.276707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.276829 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.277051 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.277052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.277052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.277388 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:55.277544 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.278214 (+ 670us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.278392 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":110,"threads_started":1}
I20260620 14:55:55.282580 13375 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:55:55.283411 13375 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:55:55.292824 13375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f7cb13ce4a144c980d6297a644acc9d: Generated new TSK 0
I20260620 14:55:55.293109 13375 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:55:55.332696 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37265
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:55.431849 13387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:55.432089 13387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:55.432121 13387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:55.433468 13387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:55.433526 13387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:55.433557 13387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:55:55.435258 13387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37265
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:55.435637 13387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:55.435890 13387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:55.442222 13392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.442241 13393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.442222 13395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:55.442595 13387 server_base.cc:1034] running on GCE node
I20260620 14:55:55.442835 13387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:55.443158 13387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:55.444407 13387 hybrid_clock.cc:648] HybridClock initialized: now 1781967355444396 us; error 45 us; skew 500 ppm
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:55.447356 13387 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:55:55.447878 13387 webserver.cc:460] Webserver started at http://127.12.116.129:45965/ using document root <none> and password file <none>
I20260620 14:55:55.448170 13387 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:55.448221 13387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:55.448369 13387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:55.449520 13387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "07e89f0cbabe41cea1528b3f93a4e95b"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "2c17babad56f4fdd0fce9641ad40c8f5"
server_key_iv: "197799d6dce0ef73cb654389fe642611"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.450124 13387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "07e89f0cbabe41cea1528b3f93a4e95b"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "2c17babad56f4fdd0fce9641ad40c8f5"
server_key_iv: "197799d6dce0ef73cb654389fe642611"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.451751 13387 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:55:55.452790 13402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.453293 13387 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:55.453385 13387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "07e89f0cbabe41cea1528b3f93a4e95b"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "2c17babad56f4fdd0fce9641ad40c8f5"
server_key_iv: "197799d6dce0ef73cb654389fe642611"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.453454 13387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:55.462606 13387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:55.466318 13387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:55.466486 13387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:55.466717 13387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:55:55.467176 13387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:55.467259 13387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.467339 13387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:55.467393 13387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.477288 13387 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40829
I20260620 14:55:55.477345 13515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40829 every 8 connection(s)
I20260620 14:55:55.477739 13387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:55:55.478976 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13387
I20260620 14:55:55.479081 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:55:55.479260 12754 external_mini_cluster.cc:1428] Setting key 063d9090ff4565f725e4bc6b876ae2df
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:55:55.491600 13365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.478712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:53517 (local address 127.12.116.190:37265)
0620 14:55:55.478832 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.478835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.479001 (+ 166us) server_negotiation.cc:407] Connection header received
0620 14:55:55.480500 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.480501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.480569 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.480642 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:55.481434 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.481972 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.483090 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.483330 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.483416 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.486268 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:55.486272 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:55.486272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:55.486285 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:55.488479 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.489478 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.489480 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.489481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.489583 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.490398 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.490400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.490400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.490816 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:55.490912 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.491380 (+ 468us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.491515 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260620 14:55:55.492256 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.478586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37265 (local address 127.12.116.129:53517)
0620 14:55:55.478842 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:55.478899 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:55.480374 (+ 1475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:55.480755 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:55.480759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:55.481087 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:55.481308 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.481313 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.482095 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.482097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.482964 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.482967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.483428 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.483429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.483595 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.484251 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:55.484261 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:55.486059 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:55.488623 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:55.488638 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:55.488641 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:55.489311 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:55.489775 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:55.489777 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:55.489778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:55.490120 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:55.490967 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:55.490977 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:55.491174 (+ 197us) client_negotiation.cc:769] Sending connection context
0620 14:55:55.491293 (+ 119us) client_negotiation.cc:240] Negotiation successful
0620 14:55:55.491630 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":93,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
I20260620 14:55:55.494051 13516 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37265
I20260620 14:55:55.494171 13516 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:55.494441 13516 heartbeater.cc:511] Master 127.12.116.190:37265 requested a full tablet report, sending...
I20260620 14:55:55.495107 13325 ts_manager.cc:194] Registered new tserver with Master: 07e89f0cbabe41cea1528b3f93a4e95b (127.12.116.129:40829)
I20260620 14:55:55.495837 13325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:53517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:55:55.512491 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37265
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:55.614161 13521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:55.614434 13521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:55.614463 13521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:55.615800 13521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:55.615860 13521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:55.615891 13521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:55:55.617645 13521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37265
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:55.617900 13521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:55.618225 13521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:55.625454 13529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.625479 13527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.625594 13526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:55.625780 13521 server_base.cc:1034] running on GCE node
I20260620 14:55:55.626101 13521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:55.626415 13521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:55.627657 13521 hybrid_clock.cc:648] HybridClock initialized: now 1781967355627597 us; error 72 us; skew 500 ppm
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:55.631664 13521 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:55:55.632248 13521 webserver.cc:460] Webserver started at http://127.12.116.130:40649/ using document root <none> and password file <none>
I20260620 14:55:55.632822 13521 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:55.632966 13521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:55.633121 13521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:55.634577 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "c5b40aadf3a84e9791d2d00d0afa9d26"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "cb4d609d7f62d52d02cd7435f0d3f688"
server_key_iv: "285869b26abe54f6b0c6cfdef7afd04d"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.634989 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "c5b40aadf3a84e9791d2d00d0afa9d26"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "cb4d609d7f62d52d02cd7435f0d3f688"
server_key_iv: "285869b26abe54f6b0c6cfdef7afd04d"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.637117 13521 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:55:55.638429 13536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.638676 13521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:55.638829 13521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "c5b40aadf3a84e9791d2d00d0afa9d26"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "cb4d609d7f62d52d02cd7435f0d3f688"
server_key_iv: "285869b26abe54f6b0c6cfdef7afd04d"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.638942 13521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:55.647903 13521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:55.651381 13521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:55.651572 13521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:55.651844 13521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:55:55.652185 13521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:55.652240 13521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.652287 13521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:55.652311 13521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.659502 13521 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:42315
I20260620 14:55:55.659627 13649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:42315 every 8 connection(s)
I20260620 14:55:55.659992 13521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:55:55.668938 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13521
I20260620 14:55:55.669060 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:55:55.669270 12754 external_mini_cluster.cc:1428] Setting key e1674ab75548ff0728e75e1fdaf9dca2
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:55.675225 13365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.661293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:53361 (local address 127.12.116.190:37265)
0620 14:55:55.661346 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.661349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.661767 (+ 418us) server_negotiation.cc:407] Connection header received
0620 14:55:55.663163 (+ 1396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.663164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.663239 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.663286 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:55.664628 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.665148 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.666650 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.666858 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.666929 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.670782 (+ 3853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:55.670784 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:55.670784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:55.670793 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:55.673342 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.673975 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.673977 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.673978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.674064 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.674399 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.674400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.674401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.674557 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:55.674656 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.674989 (+ 333us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.675104 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:55:55.675463 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.661036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37265 (local address 127.12.116.130:53361)
0620 14:55:55.661508 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:55.661578 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:55.662887 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:55.663373 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:55.663378 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:55.663963 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:55.664255 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.664264 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.665327 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.665328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.666435 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.666440 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.666977 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.666978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.667132 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.667998 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:55.668009 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:55.670625 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:55.673470 (+ 2845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:55.673482 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:55.673485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:55.673832 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:55.674174 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:55.674176 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:55.674176 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:55.674317 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:55.674644 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:55.674652 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:55.674827 (+ 175us) client_negotiation.cc:769] Sending connection context
0620 14:55:55.674961 (+ 134us) client_negotiation.cc:240] Negotiation successful
0620 14:55:55.675160 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":89,"threads_started":1}
I20260620 14:55:55.676266 13650 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37265
I20260620 14:55:55.676467 13650 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:55.676851 13650 heartbeater.cc:511] Master 127.12.116.190:37265 requested a full tablet report, sending...
I20260620 14:55:55.677395 13325 ts_manager.cc:194] Registered new tserver with Master: c5b40aadf3a84e9791d2d00d0afa9d26 (127.12.116.130:42315)
I20260620 14:55:55.677995 13325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:53361
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:55:55.700203 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37265
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:55.803063 13655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:55.803395 13655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:55.803444 13655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:55.805191 13655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:55.805284 13655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:55.805337 13655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:55:55.807235 13655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37265
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:55.807585 13655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:55.807993 13655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:55:55.814252 13655 server_base.cc:1034] running on GCE node
W20260620 14:55:55.814193 13663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.814216 13660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:55.814193 13661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:55.814699 13655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:55.814961 13655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:55.816116 13655 hybrid_clock.cc:648] HybridClock initialized: now 1781967355816102 us; error 37 us; skew 500 ppm
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:55.819283 13655 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:55:55.819900 13655 webserver.cc:460] Webserver started at http://127.12.116.131:46645/ using document root <none> and password file <none>
I20260620 14:55:55.820217 13655 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:55.820307 13655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:55.820530 13655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:55.821756 13655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "e7556c9e4ca648f7924b190d97827136"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "12266579d3f46988b772dfea83086b48"
server_key_iv: "01a779a8a2f3e832a8cc490c2540f48f"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.822146 13655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "e7556c9e4ca648f7924b190d97827136"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "12266579d3f46988b772dfea83086b48"
server_key_iv: "01a779a8a2f3e832a8cc490c2540f48f"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.823846 13655 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:55:55.824858 13670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.825340 13655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:55.825433 13655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "e7556c9e4ca648f7924b190d97827136"
format_stamp: "Formatted at 2026-06-20 14:55:55 on dist-test-slave-7v06"
server_key: "12266579d3f46988b772dfea83086b48"
server_key_iv: "01a779a8a2f3e832a8cc490c2540f48f"
server_key_version: "encryptionkey@0"
I20260620 14:55:55.825554 13655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:55.837534 13655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:55.840422 13655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:55.840590 13655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:55.840860 13655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:55:55.841199 13655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:55.841234 13655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.841257 13655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:55.841305 13655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:55.848886 13655 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:33423
I20260620 14:55:55.849021 13783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:33423 every 8 connection(s)
I20260620 14:55:55.849337 13655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
Jun 20 14:55:55 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:55.856839 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13655
I20260620 14:55:55.857002 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:55:55.857227 12754 external_mini_cluster.cc:1428] Setting key 380c4f53f9de43a29d58f5c0a9224162
I20260620 14:55:55.861490 13365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.850483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:45727 (local address 127.12.116.190:37265)
0620 14:55:55.850567 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.850569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.850775 (+ 206us) server_negotiation.cc:407] Connection header received
0620 14:55:55.851776 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.851786 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.851798 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.851867 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:55.852734 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.853273 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.854436 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.854690 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.854756 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.857550 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:55.857553 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:55.857553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:55.857564 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:55.859593 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.860168 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.860170 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.860170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.860251 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.860692 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.860693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.860694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.860863 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:55.860951 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.861291 (+ 340us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.861394 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260620 14:55:55.861725 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.850403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37265 (local address 127.12.116.131:45727)
0620 14:55:55.850579 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:55.850622 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:55.851594 (+ 972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:55.851957 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:55.851960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:55.852290 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:55.852608 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.852614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.853387 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.853389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.854314 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.854316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.854818 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.854820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.854948 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.855675 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:55.855686 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:55.857410 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:55.859732 (+ 2322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:55.859745 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:55.859749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:55.860075 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:55.860366 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:55.860367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:55.860368 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:55.860534 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:55.860960 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:55.860967 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:55.861132 (+ 165us) client_negotiation.cc:769] Sending connection context
0620 14:55:55.861257 (+ 125us) client_negotiation.cc:240] Negotiation successful
0620 14:55:55.861442 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":111,"threads_started":1}
I20260620 14:55:55.862370 13784 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37265
I20260620 14:55:55.862506 13784 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:55.862726 13784 heartbeater.cc:511] Master 127.12.116.190:37265 requested a full tablet report, sending...
I20260620 14:55:55.863224 13325 ts_manager.cc:194] Registered new tserver with Master: e7556c9e4ca648f7924b190d97827136 (127.12.116.131:33423)
I20260620 14:55:55.863620 13325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:45727
I20260620 14:55:55.870923 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:55:55.879748 13365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.872974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47416 (local address 127.12.116.190:37265)
0620 14:55:55.873061 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.873063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.873072 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:55:55.873101 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.873102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.873112 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.873180 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:55.873796 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.874372 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.875122 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.875337 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.875418 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.876892 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:55.876893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:55.876894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:55.876903 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:55.878425 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.878829 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.878831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.878831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.878897 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:55.879108 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:55.879109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:55.879110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:55.879303 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:55.879418 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.879540 (+ 122us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.879633 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260620 14:55:55.882938 13325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47416:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:55:55.885097 13325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:55:55.893780 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.888477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40829 (local address 127.0.0.1:60332)
0620 14:55:55.888684 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:55.888732 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:55.888802 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:55.889198 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:55.889199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:55.889201 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:55.889335 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.889338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.890537 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.890539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.891993 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.891997 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.893203 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.893205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.893371 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.893410 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 14:55:55.893540 (+ 130us) client_negotiation.cc:240] Negotiation successful
0620 14:55:55.893642 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":8,"thread_start_us":58,"threads_started":1}
I20260620 14:55:55.893857 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.888685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60332 (local address 127.12.116.129:40829)
0620 14:55:55.888859 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.888863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.888875 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:55:55.888920 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.888923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.889001 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.889098 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:55.889448 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.890415 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.892122 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.893041 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.893148 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.893218 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.893667 (+ 449us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.893744 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":71,"threads_started":1}
I20260620 14:55:55.893965 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.888790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42315 (local address 127.0.0.1:33930)
0620 14:55:55.889053 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:55.889063 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:55.889103 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:55.889392 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:55.889393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:55.889395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:55.889433 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.889434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.891024 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.891025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.892112 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.892114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.893710 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.893712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.893776 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.893782 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:55:55.893816 (+ 34us) client_negotiation.cc:240] Negotiation successful
0620 14:55:55.893875 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":86,"threads_started":1}
I20260620 14:55:55.894822 13450 tablet_service.cc:1467] Processing CreateTablet for tablet 99e5200f96d44b57b2067176265052b4 (DEFAULT_TABLE table=test-table [id=ae1d10aaf3cd451dbedff137f563a456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:55.895222 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.888485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:33423 (local address 127.0.0.1:34392)
0620 14:55:55.888843 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:55.888854 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:55.888926 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:55.889187 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:55.889191 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:55.889194 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:55.889340 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.889343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.892223 (+ 2880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.892224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.893394 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:55.893400 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.894878 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.894881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:55.894975 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.894984 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 14:55:55.895025 (+ 41us) client_negotiation.cc:240] Negotiation successful
0620 14:55:55.895100 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":32,"thread_start_us":178,"threads_started":1}
I20260620 14:55:55.895313 13450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e5200f96d44b57b2067176265052b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:55.895732 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.889048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33930 (local address 127.12.116.130:42315)
0620 14:55:55.889226 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.889231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.889241 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:55:55.889283 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.889285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.889302 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.889380 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:55.889529 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.890789 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.892546 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.893589 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.894482 (+ 893us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.895455 (+ 973us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.895499 (+ 44us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.895612 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260620 14:55:55.895779 13797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:55.888566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.12.116.131:33423)
0620 14:55:55.888789 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:55.888794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:55.888927 (+ 133us) server_negotiation.cc:407] Connection header received
0620 14:55:55.889020 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:55.889023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:55.889041 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:55.889236 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:55.889433 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.890789 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.893793 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:55.894724 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:55.895485 (+ 761us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:55.895581 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:55.895621 (+ 40us) server_negotiation.cc:299] Negotiation successful
0620 14:55:55.895680 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":98,"threads_started":1}
I20260620 14:55:55.897336 13718 tablet_service.cc:1467] Processing CreateTablet for tablet 99e5200f96d44b57b2067176265052b4 (DEFAULT_TABLE table=test-table [id=ae1d10aaf3cd451dbedff137f563a456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:55.897336 13584 tablet_service.cc:1467] Processing CreateTablet for tablet 99e5200f96d44b57b2067176265052b4 (DEFAULT_TABLE table=test-table [id=ae1d10aaf3cd451dbedff137f563a456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:55.897797 13584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e5200f96d44b57b2067176265052b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:55.897799 13718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e5200f96d44b57b2067176265052b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:55.899993 13801 tablet_bootstrap.cc:492] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: Bootstrap starting.
I20260620 14:55:55.900890 13801 tablet_bootstrap.cc:654] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:55.901477 13801 log.cc:824] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:55.902140 13803 tablet_bootstrap.cc:492] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: Bootstrap starting.
I20260620 14:55:55.902346 13801 tablet_bootstrap.cc:492] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: No bootstrap required, opened a new log
I20260620 14:55:55.902410 13801 ts_tablet_manager.cc:1397] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:55:55.902858 13803 tablet_bootstrap.cc:654] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:55.903486 13803 log.cc:824] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:55.903923 13802 tablet_bootstrap.cc:492] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: Bootstrap starting.
I20260620 14:55:55.904469 13803 tablet_bootstrap.cc:492] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: No bootstrap required, opened a new log
I20260620 14:55:55.904543 13803 ts_tablet_manager.cc:1397] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:55:55.904703 13802 tablet_bootstrap.cc:654] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:55.904891 13801 raft_consensus.cc:348] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:55.905144 13801 raft_consensus.cc:374] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:55.905197 13801 raft_consensus.cc:729] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e89f0cbabe41cea1528b3f93a4e95b, State: Initialized, Role: FOLLOWER
I20260620 14:55:55.905334 13802 log.cc:824] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:55.905364 13801 consensus_queue.cc:260] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:55.905720 13516 heartbeater.cc:503] Master 127.12.116.190:37265 was elected leader, sending a full tablet report...
I20260620 14:55:55.905709 13801 ts_tablet_manager.cc:1428] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:55:55.906363 13802 tablet_bootstrap.cc:492] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: No bootstrap required, opened a new log
I20260620 14:55:55.906560 13802 ts_tablet_manager.cc:1397] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:55:55.906934 13803 raft_consensus.cc:348] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:55.907130 13803 raft_consensus.cc:374] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:55.907171 13803 raft_consensus.cc:729] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b40aadf3a84e9791d2d00d0afa9d26, State: Initialized, Role: FOLLOWER
I20260620 14:55:55.907711 13803 consensus_queue.cc:260] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:55.908059 13803 ts_tablet_manager.cc:1428] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:55:55.908105 13650 heartbeater.cc:503] Master 127.12.116.190:37265 was elected leader, sending a full tablet report...
I20260620 14:55:55.909622 13802 raft_consensus.cc:348] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:55.909794 13802 raft_consensus.cc:374] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:55.909819 13802 raft_consensus.cc:729] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7556c9e4ca648f7924b190d97827136, State: Initialized, Role: FOLLOWER
I20260620 14:55:55.909972 13802 consensus_queue.cc:260] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:55.910319 13784 heartbeater.cc:503] Master 127.12.116.190:37265 was elected leader, sending a full tablet report...
I20260620 14:55:55.910331 13802 ts_tablet_manager.cc:1428] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
W20260620 14:55:55.910630 13651 tablet.cc:2369] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:55:55.978879 13517 tablet.cc:2369] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:55:56.091159 13809 raft_consensus.cc:482] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:55:56.091312 13809 raft_consensus.cc:504] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:56.091753 13809 leader_election.cc:288] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07e89f0cbabe41cea1528b3f93a4e95b (127.12.116.129:40829), c5b40aadf3a84e9791d2d00d0afa9d26 (127.12.116.130:42315)
I20260620 14:55:56.096138 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.091987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40829 (local address 127.12.116.131:50049)
0620 14:55:56.092064 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:56.092077 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:56.092134 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:56.092394 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:56.092395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:56.092398 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:56.092474 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:56.092476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.093571 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.093573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:56.094908 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:56.094912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.095768 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.095769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:56.095870 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.095875 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:55:56.095943 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 14:55:56.096007 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":30}
I20260620 14:55:56.096148 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.091994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42315 (local address 127.12.116.131:40065)
0620 14:55:56.092419 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:56.092430 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:56.092506 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:56.092728 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:56.092728 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:56.092730 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:56.092778 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:56.092779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.093676 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.093676 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:56.094908 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:56.094912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.095768 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.095769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:56.095875 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.095879 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:55:56.095943 (+ 64us) client_negotiation.cc:240] Negotiation successful
0620 14:55:56.096007 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":102,"thread_start_us":120,"threads_started":1}
I20260620 14:55:56.096429 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.092063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:40065 (local address 127.12.116.130:42315)
0620 14:55:56.092112 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:56.092114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:56.092571 (+ 457us) server_negotiation.cc:407] Connection header received
0620 14:55:56.092632 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:56.092634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:56.092644 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:56.092714 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:56.092894 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.093579 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.095049 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.095645 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.095763 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.095772 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:56.096101 (+ 329us) server_negotiation.cc:299] Negotiation successful
0620 14:55:56.096192 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:55:56.096449 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.092037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:50049 (local address 127.12.116.129:40829)
0620 14:55:56.092095 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:56.092098 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:56.092116 (+ 18us) server_negotiation.cc:407] Connection header received
0620 14:55:56.092208 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:56.092213 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:56.092224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:56.092296 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:56.092593 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.093467 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.095050 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.095646 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.095740 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.095751 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:56.096102 (+ 351us) server_negotiation.cc:299] Negotiation successful
0620 14:55:56.096188 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:55:56.096771 13470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e5200f96d44b57b2067176265052b4" candidate_uuid: "e7556c9e4ca648f7924b190d97827136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" is_pre_election: true
I20260620 14:55:56.096771 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e5200f96d44b57b2067176265052b4" candidate_uuid: "e7556c9e4ca648f7924b190d97827136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" is_pre_election: true
I20260620 14:55:56.096951 13470 raft_consensus.cc:2454] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7556c9e4ca648f7924b190d97827136 in term 0.
I20260620 14:55:56.096951 13604 raft_consensus.cc:2454] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7556c9e4ca648f7924b190d97827136 in term 0.
I20260620 14:55:56.097231 13674 leader_election.cc:302] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e89f0cbabe41cea1528b3f93a4e95b, e7556c9e4ca648f7924b190d97827136; no voters:
I20260620 14:55:56.097412 13809 raft_consensus.cc:2781] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:55:56.097473 13809 raft_consensus.cc:482] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:55:56.097496 13809 raft_consensus.cc:3037] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:56.098196 13809 raft_consensus.cc:504] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:56.098357 13809 leader_election.cc:288] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [CANDIDATE]: Term 1 election: Requested vote from peers 07e89f0cbabe41cea1528b3f93a4e95b (127.12.116.129:40829), c5b40aadf3a84e9791d2d00d0afa9d26 (127.12.116.130:42315)
I20260620 14:55:56.098527 13470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e5200f96d44b57b2067176265052b4" candidate_uuid: "e7556c9e4ca648f7924b190d97827136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07e89f0cbabe41cea1528b3f93a4e95b"
I20260620 14:55:56.098613 13470 raft_consensus.cc:3037] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:56.098559 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e5200f96d44b57b2067176265052b4" candidate_uuid: "e7556c9e4ca648f7924b190d97827136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26"
I20260620 14:55:56.098732 13604 raft_consensus.cc:3037] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:56.099373 13470 raft_consensus.cc:2454] T 99e5200f96d44b57b2067176265052b4 P 07e89f0cbabe41cea1528b3f93a4e95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7556c9e4ca648f7924b190d97827136 in term 1.
I20260620 14:55:56.099565 13604 raft_consensus.cc:2454] T 99e5200f96d44b57b2067176265052b4 P c5b40aadf3a84e9791d2d00d0afa9d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7556c9e4ca648f7924b190d97827136 in term 1.
I20260620 14:55:56.099568 13674 leader_election.cc:302] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e89f0cbabe41cea1528b3f93a4e95b, e7556c9e4ca648f7924b190d97827136; no voters:
I20260620 14:55:56.099797 13809 raft_consensus.cc:2781] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:56.099941 13809 raft_consensus.cc:686] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [term 1 LEADER]: Becoming Leader. State: Replica: e7556c9e4ca648f7924b190d97827136, State: Running, Role: LEADER
W20260620 14:55:56.100098 13785 tablet.cc:2369] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:55:56.100075 13809 consensus_queue.cc:237] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } }
I20260620 14:55:56.101243 13325 catalog_manager.cc:5495] T 99e5200f96d44b57b2067176265052b4 P e7556c9e4ca648f7924b190d97827136 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7556c9e4ca648f7924b190d97827136 (127.12.116.131). New cstate: current_term: 1 leader_uuid: "e7556c9e4ca648f7924b190d97827136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7556c9e4ca648f7924b190d97827136" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07e89f0cbabe41cea1528b3f93a4e95b" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5b40aadf3a84e9791d2d00d0afa9d26" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42315 } health_report { overall_health: UNKNOWN } } }
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:55:56.132287 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.122200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60346 (local address 127.12.116.129:40829)
0620 14:55:56.122278 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:56.122280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:56.122291 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:55:56.122325 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:56.122326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:56.122334 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:56.122390 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:56.123062 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.123555 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.124636 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.124835 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.124906 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.127502 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:56.127517 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:56.127517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:56.127527 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:56.130150 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:56.130853 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:56.130857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:56.130857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:56.130947 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:56.131522 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:56.131523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:56.131524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:56.131704 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:56.131831 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:56.132103 (+ 272us) server_negotiation.cc:299] Negotiation successful
0620 14:55:56.132201 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:55:56.167733 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.152945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60348 (local address 127.12.116.129:40829)
0620 14:55:56.153058 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:56.153061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:56.153259 (+ 198us) server_negotiation.cc:407] Connection header received
0620 14:55:56.153311 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:56.153313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:56.153324 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:56.153402 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:56.156687 (+ 3285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.157645 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.159206 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.159650 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.159760 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.163863 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:56.163865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:56.163866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:56.163877 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:56.165758 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:56.166299 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:56.166301 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:56.166301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:56.166388 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:56.166757 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:56.166758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:56.166759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:56.166963 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:56.167136 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:56.167456 (+ 320us) server_negotiation.cc:299] Negotiation successful
0620 14:55:56.167567 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:55:56.203341 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:56.193367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60350 (local address 127.12.116.129:40829)
0620 14:55:56.193479 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:56.193482 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:56.193628 (+ 146us) server_negotiation.cc:407] Connection header received
0620 14:55:56.193710 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:56.193711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:56.193724 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:56.193778 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:56.194469 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.195002 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.195779 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:56.195992 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:56.196073 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:56.199763 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:56.199765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:56.199766 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:56.199776 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:56.201502 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:56.202187 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:56.202189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:56.202189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:56.202279 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:56.202654 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:56.202655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:56.202655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:56.202816 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:56.202915 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:56.203184 (+ 269us) server_negotiation.cc:299] Negotiation successful
0620 14:55:56.203268 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260620 14:55:56.204047 13430 tablet_service.cc:2908] Rejecting scan request for tablet 99e5200f96d44b57b2067176265052b4: Uninitialized: clean time has not yet been initialized
I20260620 14:55:56.205973 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13387
I20260620 14:55:56.212019 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13521
I20260620 14:55:56.218464 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13655
I20260620 14:55:56.223915 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13293
2026-06-20T14:55:56Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2360 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13825](info): set up 2 sockets
Jun 20 14:55:56 dist-test-slave-7v06 krb5kdc[13825](info): commencing operation
krb5kdc: starting...
W20260620 14:55:57.340765 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:55:57 dist-test-slave-7v06 krb5kdc[13825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:55:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:55:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:55:57.480962 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40587
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:40587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:57.568454 13838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:57.568751 13838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:57.568779 13838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:57.571038 13838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:55:57.571125 13838 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260620 14:55:57.571139 13838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:57.571154 13838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:57.571167 13838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:55:57.571180 13838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:55:57.573712 13838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:40587
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:57.574180 13838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:57.574493 13838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:57.580579 13846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:57.580617 13843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:57.580749 13838 server_base.cc:1034] running on GCE node
W20260620 14:55:57.580828 13844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:57.581179 13838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:57.581517 13838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:57.582726 13838 hybrid_clock.cc:648] HybridClock initialized: now 1781967357582734 us; error 56 us; skew 500 ppm
Jun 20 14:55:57 dist-test-slave-7v06 krb5kdc[13825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967357, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:57.590958 13838 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:55:57.591569 13838 webserver.cc:460] Webserver started at http://127.12.116.190:35265/ using document root <none> and password file <none>
I20260620 14:55:57.591833 13838 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:57.591912 13838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:57.592080 13838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:57.593353 13838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "9aa3eb80e05a4a36b555c91eb09adf7b"
format_stamp: "Formatted at 2026-06-20 14:55:57 on dist-test-slave-7v06"
server_key: "e88ab736442aa1f4b940dc6fff8ba471"
server_key_iv: "c958cc14e3066542fb9707881c2ce7a0"
server_key_version: "encryptionkey@0"
I20260620 14:55:57.593775 13838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "9aa3eb80e05a4a36b555c91eb09adf7b"
format_stamp: "Formatted at 2026-06-20 14:55:57 on dist-test-slave-7v06"
server_key: "e88ab736442aa1f4b940dc6fff8ba471"
server_key_iv: "c958cc14e3066542fb9707881c2ce7a0"
server_key_version: "encryptionkey@0"
I20260620 14:55:57.595541 13838 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260620 14:55:57.596771 13853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:57.597126 13838 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:55:57.597266 13838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "9aa3eb80e05a4a36b555c91eb09adf7b"
format_stamp: "Formatted at 2026-06-20 14:55:57 on dist-test-slave-7v06"
server_key: "e88ab736442aa1f4b940dc6fff8ba471"
server_key_iv: "c958cc14e3066542fb9707881c2ce7a0"
server_key_version: "encryptionkey@0"
I20260620 14:55:57.597378 13838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:57.611925 13838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:57.614499 13838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:57.614661 13838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:57.619570 13838 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:40587
I20260620 14:55:57.619665 13915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:40587 every 8 connection(s)
I20260620 14:55:57.620016 13838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:55:57.620790 13916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:57.623556 13916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: Bootstrap starting.
I20260620 14:55:57.624265 13916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:57.624639 13916 log.cc:824] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:57.625555 13916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: No bootstrap required, opened a new log
I20260620 14:55:57.627300 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13838
I20260620 14:55:57.627389 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:55:57.627637 12754 external_mini_cluster.cc:1428] Setting key c2a09d1c6e008bde936af645d5a18e5b
I20260620 14:55:57.628208 13916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40587 } }
I20260620 14:55:57.628471 13916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:57.628525 13916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa3eb80e05a4a36b555c91eb09adf7b, State: Initialized, Role: FOLLOWER
I20260620 14:55:57.628703 13916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40587 } }
I20260620 14:55:57.628782 13916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:55:57.628804 13916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:55:57.628876 13916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:57.629806 13916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40587 } }
I20260620 14:55:57.629926 13916 leader_election.cc:302] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9aa3eb80e05a4a36b555c91eb09adf7b; no voters:
I20260620 14:55:57.630127 13916 leader_election.cc:288] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:55:57.630185 13921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:57.630313 13921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [term 1 LEADER]: Becoming Leader. State: Replica: 9aa3eb80e05a4a36b555c91eb09adf7b, State: Running, Role: LEADER
I20260620 14:55:57.630430 13916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:55:57.630399 13921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40587 } }
I20260620 14:55:57.630782 13921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9aa3eb80e05a4a36b555c91eb09adf7b. Latest consensus state: current_term: 1 leader_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40587 } } }
I20260620 14:55:57.630863 13921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [sys.catalog]: This master's current role is: LEADER
I20260620 14:55:57.630811 13923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aa3eb80e05a4a36b555c91eb09adf7b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40587 } } }
I20260620 14:55:57.631023 13923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b [sys.catalog]: This master's current role is: LEADER
I20260620 14:55:57.631081 13926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:55:57.631717 13926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:55:57.634421 13938 mvcc.cc:205] Tried to move back new op lower bound from 7298938296868208640 to 7298938296854749184. Current Snapshot: MvccSnapshot[applied={T|T < 7298938296868208640}]
I20260620 14:55:57.634976 13926 catalog_manager.cc:1347] Generated new cluster ID: 07f8b8921b6d4ec3a81b77a09e33d979
I20260620 14:55:57.635039 13926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:55:57 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:57.641024 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:57.628319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.12.116.190:40587)
0620 14:55:57.628569 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:57.628596 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:57.628635 (+ 39us) server_negotiation.cc:407] Connection header received
0620 14:55:57.628804 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:57.628813 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:57.628879 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:57.629050 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:57.629847 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.631359 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.632710 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.633351 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.633472 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:57.636520 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:57.636525 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:57.636525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:57.636555 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:57.638948 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:57.639471 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:57.639475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:57.639475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:57.639623 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:57.639995 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:57.639996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:57.639996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:57.640303 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:57.640532 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:57.640634 (+ 102us) server_negotiation.cc:299] Negotiation successful
0620 14:55:57.640811 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":122,"threads_started":1}
I20260620 14:55:57.646883 13926 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:55:57.647720 13926 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:55:57.657244 13926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: Generated new TSK 0
I20260620 14:55:57.657545 13926 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:55:57.714417 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40587
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:57.831756 13942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:57.832026 13942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:57.832136 13942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:57.833787 13942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:57.833897 13942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:57.833937 13942 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:55:57.833976 13942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:55:57.835923 13942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:57.836313 13942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:57.836689 13942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:57.843065 13947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:57.843065 13948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:57.843097 13950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:57.844020 13942 server_base.cc:1034] running on GCE node
I20260620 14:55:57.844318 13942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:57.844695 13942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:57.845904 13942 hybrid_clock.cc:648] HybridClock initialized: now 1781967357845873 us; error 46 us; skew 500 ppm
Jun 20 14:55:57 dist-test-slave-7v06 krb5kdc[13825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967357, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:57.849601 13942 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:55:57.850427 13942 webserver.cc:460] Webserver started at http://127.12.116.129:40085/ using document root <none> and password file <none>
I20260620 14:55:57.850742 13942 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:57.850798 13942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:57.850958 13942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:57.852171 13942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "3e4784dea50a49db8bad1e74c925df85"
format_stamp: "Formatted at 2026-06-20 14:55:57 on dist-test-slave-7v06"
server_key: "379e01c323ca15ca2fe492eec9490f25"
server_key_iv: "0d7ab34c7337220e4269810e1edee666"
server_key_version: "encryptionkey@0"
I20260620 14:55:57.852662 13942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "3e4784dea50a49db8bad1e74c925df85"
format_stamp: "Formatted at 2026-06-20 14:55:57 on dist-test-slave-7v06"
server_key: "379e01c323ca15ca2fe492eec9490f25"
server_key_iv: "0d7ab34c7337220e4269810e1edee666"
server_key_version: "encryptionkey@0"
I20260620 14:55:57.854331 13942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:55:57.855490 13957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:57.856050 13942 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:57.856281 13942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "3e4784dea50a49db8bad1e74c925df85"
format_stamp: "Formatted at 2026-06-20 14:55:57 on dist-test-slave-7v06"
server_key: "379e01c323ca15ca2fe492eec9490f25"
server_key_iv: "0d7ab34c7337220e4269810e1edee666"
server_key_version: "encryptionkey@0"
I20260620 14:55:57.856516 13942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:57.868826 13942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:57.871448 13942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:57.871640 13942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:57.872192 13942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:57.872262 13942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:57.872315 13942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:57.872373 13942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:55:57 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967357, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:57.879691 13942 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:43157
I20260620 14:55:57.879846 14072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:43157 every 8 connection(s)
I20260620 14:55:57.880127 13942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:55:57.883419 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 13942
I20260620 14:55:57.883607 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:55:57.883792 12754 external_mini_cluster.cc:1428] Setting key 1db42be909e03fe005ceb8c4e363250f
I20260620 14:55:57.883886 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:57.872801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:47375 (local address 127.12.116.190:40587)
0620 14:55:57.872878 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:57.872881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:57.873173 (+ 292us) server_negotiation.cc:407] Connection header received
0620 14:55:57.873840 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:57.873842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:57.873862 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:57.873940 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:57.874930 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.875797 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.877107 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.877349 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.877444 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:57.880251 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:57.880254 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:57.880254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:57.880271 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:57.882058 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:57.882578 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:57.882579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:57.882607 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:57.882668 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:57.882991 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:57.882992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:57.882992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:57.883137 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:57.883208 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:57.883683 (+ 475us) server_negotiation.cc:299] Negotiation successful
0620 14:55:57.883792 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 14:55:57.884104 13966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:57.872776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.12.116.129:47375)
0620 14:55:57.872957 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:57.872998 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:57.873713 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:57.874040 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:57.874045 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:57.874442 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:57.874808 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:57.874815 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.875936 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.875938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:57.876999 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:57.877002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.877473 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.877474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:57.877615 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:57.878253 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:57.878262 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:57.880053 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:57.882194 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:57.882202 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:57.882204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:57.882468 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:57.882781 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:57.882781 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:57.882782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:57.882891 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:57.883285 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:57.883292 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:57.883434 (+ 142us) client_negotiation.cc:769] Sending connection context
0620 14:55:57.883617 (+ 183us) client_negotiation.cc:240] Negotiation successful
0620 14:55:57.883838 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":111,"threads_started":1}
I20260620 14:55:57.884797 14073 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40587
I20260620 14:55:57.884912 14073 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:57.885126 14073 heartbeater.cc:511] Master 127.12.116.190:40587 requested a full tablet report, sending...
I20260620 14:55:57.885739 13869 ts_manager.cc:194] Registered new tserver with Master: 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129:43157)
I20260620 14:55:57.886760 13869 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:47375
I20260620 14:55:57.893318 14080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:57.886156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.12.116.129:38289)
0620 14:55:57.886296 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:57.886306 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:57.886396 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:57.886515 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:57.886516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:57.886734 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:57.886793 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:57.886795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.887757 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.887759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:57.888306 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:57.888308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.888756 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.888757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:57.888836 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:57.889525 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:57.889530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:57.889860 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:57.891712 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:57.891714 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:57.891715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:57.891919 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:57.892159 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:57.892160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:57.892161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:57.892235 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:57.892594 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:57.892595 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:57.892758 (+ 163us) client_negotiation.cc:769] Sending connection context
0620 14:55:57.892980 (+ 222us) client_negotiation.cc:240] Negotiation successful
0620 14:55:57.893187 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":88,"threads_started":1}
I20260620 14:55:57.893318 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:57.886064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:38289 (local address 127.12.116.190:40587)
0620 14:55:57.886115 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:57.886118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:57.886379 (+ 261us) server_negotiation.cc:407] Connection header received
0620 14:55:57.886450 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:57.886451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:57.886461 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:57.886513 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:57.886880 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.887631 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.888442 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:57.888670 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:57.888757 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:57.890000 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:57.890002 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:57.890002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:57.890010 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:57.891592 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:57.892014 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:57.892016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:57.892017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:57.892086 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:57.892302 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:57.892303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:57.892304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:57.892499 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:57.892580 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:57.893044 (+ 464us) server_negotiation.cc:299] Negotiation successful
0620 14:55:57.893182 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:55:57.916704 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40587
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:58.011200 14082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:58.011523 14082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:58.011570 14082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:58.013029 14082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:58.013123 14082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:58.013159 14082 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:55:58.013199 14082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:55:58.016839 14082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:58.017278 14082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:58.017562 14082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:58.023227 14088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:58.023257 14087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:58.023231 14090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:58.023617 14082 server_base.cc:1034] running on GCE node
I20260620 14:55:58.023855 14082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:58.024120 14082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:58.025290 14082 hybrid_clock.cc:648] HybridClock initialized: now 1781967358025282 us; error 41 us; skew 500 ppm
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:58.027933 14082 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:55:58.028517 14082 webserver.cc:460] Webserver started at http://127.12.116.130:43243/ using document root <none> and password file <none>
I20260620 14:55:58.028779 14082 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:58.028852 14082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:58.029008 14082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:58.030215 14082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "387c3c0832404ad498fd99e28ba7d262"
format_stamp: "Formatted at 2026-06-20 14:55:58 on dist-test-slave-7v06"
server_key: "15b451545735c947c263412b988ec0f8"
server_key_iv: "f35d75847c438acd20da2b2fc51945e5"
server_key_version: "encryptionkey@0"
I20260620 14:55:58.030649 14082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "387c3c0832404ad498fd99e28ba7d262"
format_stamp: "Formatted at 2026-06-20 14:55:58 on dist-test-slave-7v06"
server_key: "15b451545735c947c263412b988ec0f8"
server_key_iv: "f35d75847c438acd20da2b2fc51945e5"
server_key_version: "encryptionkey@0"
I20260620 14:55:58.032253 14082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:58.033226 14097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:58.033432 14082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:58.033550 14082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "387c3c0832404ad498fd99e28ba7d262"
format_stamp: "Formatted at 2026-06-20 14:55:58 on dist-test-slave-7v06"
server_key: "15b451545735c947c263412b988ec0f8"
server_key_iv: "f35d75847c438acd20da2b2fc51945e5"
server_key_version: "encryptionkey@0"
I20260620 14:55:58.033623 14082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:58.043766 14082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:58.046316 14082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:58.046494 14082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:58.047060 14082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:58.047140 14082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:58.047299 14082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:58.047358 14082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:58.055842 14082 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:42703
I20260620 14:55:58.056267 14082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:55:58.056058 14212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:42703 every 8 connection(s)
I20260620 14:55:58.061700 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.047673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:49829 (local address 127.12.116.190:40587)
0620 14:55:58.047743 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.047745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.047940 (+ 195us) server_negotiation.cc:407] Connection header received
0620 14:55:58.048587 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.048589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.048600 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.048663 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.049386 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.050110 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.051911 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.052241 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.052359 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.055737 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.055741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.055742 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.055763 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.058774 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.059556 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.059558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.059559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.059645 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.060690 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.060691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.060691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.060850 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.060924 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.061501 (+ 577us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.061614 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 14:55:58.061862 14106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.047657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.12.116.130:49829)
0620 14:55:58.047822 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.047859 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.048463 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.048739 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.048743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.049072 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:58.049278 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.049283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.050203 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.050204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.051800 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.051804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.052414 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.052415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.052606 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.053246 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:58.053260 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:58.055368 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:58.058957 (+ 3589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.058969 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.058972 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.059367 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.060192 (+ 825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.060193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.060194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.060550 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.060961 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:58.060970 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:58.061183 (+ 213us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.061345 (+ 162us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.061589 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260620 14:55:58.062726 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 14082
I20260620 14:55:58.062856 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:55:58.062913 14213 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40587
I20260620 14:55:58.063045 14213 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:58.063056 12754 external_mini_cluster.cc:1428] Setting key 3f9e7b7e7d1fe36de8496b01b2a4ead2
I20260620 14:55:58.063349 14213 heartbeater.cc:511] Master 127.12.116.190:40587 requested a full tablet report, sending...
I20260620 14:55:58.063743 13869 ts_manager.cc:194] Registered new tserver with Master: 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703)
I20260620 14:55:58.064291 13869 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:49829
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:55:58.073539 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.064155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.12.116.130:53871)
0620 14:55:58.064499 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.064513 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.064588 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.065550 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.065552 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.065830 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:58.065902 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.065905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.066909 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.066910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.067450 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.067453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.067869 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.067870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.067972 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.068561 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:58.068567 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:58.068926 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:58.071274 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.071276 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.071276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.071854 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.072204 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.072205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.072205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.072291 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.073061 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:58.073063 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:58.073160 (+ 97us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.073238 (+ 78us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.073402 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":76,"threads_started":1}
I20260620 14:55:58.073529 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.064207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:53871 (local address 127.12.116.190:40587)
0620 14:55:58.064253 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.064255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.064569 (+ 314us) server_negotiation.cc:407] Connection header received
0620 14:55:58.064643 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.064644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.064656 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.064697 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.065997 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.066783 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.067550 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.067772 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.067865 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.069070 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.069071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.069072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.069081 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.071113 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.072000 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.072002 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.072003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.072097 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.072432 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.072433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.072434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.072961 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.073077 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.073281 (+ 204us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.073401 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:55:58.098331 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40587
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:55:58.190768 14222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:55:58.191038 14222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:55:58.191074 14222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:55:58.192531 14222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:55:58.192601 14222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:55:58.192628 14222 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:55:58.192648 14222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:55:58.194514 14222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:55:58.194777 14222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:55:58.194981 14222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:55:58.200660 14230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:58.200618 14227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:55:58.200690 14228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:55:58.201071 14222 server_base.cc:1034] running on GCE node
I20260620 14:55:58.201354 14222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:55:58.201645 14222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:55:58.202849 14222 hybrid_clock.cc:648] HybridClock initialized: now 1781967358202822 us; error 43 us; skew 500 ppm
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:55:58.206661 14222 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:55:58.207228 14222 webserver.cc:460] Webserver started at http://127.12.116.131:45949/ using document root <none> and password file <none>
I20260620 14:55:58.207499 14222 fs_manager.cc:359] Metadata directory not provided
I20260620 14:55:58.207574 14222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:55:58.207744 14222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:55:58.208983 14222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "77ac149ae0d74a65b0597cf5767309e3"
format_stamp: "Formatted at 2026-06-20 14:55:58 on dist-test-slave-7v06"
server_key: "a0bd75e6e4d1a7c077877ca1ac4ea98d"
server_key_iv: "720126d83a6a1505fd3d967045044ba9"
server_key_version: "encryptionkey@0"
I20260620 14:55:58.209388 14222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "77ac149ae0d74a65b0597cf5767309e3"
format_stamp: "Formatted at 2026-06-20 14:55:58 on dist-test-slave-7v06"
server_key: "a0bd75e6e4d1a7c077877ca1ac4ea98d"
server_key_iv: "720126d83a6a1505fd3d967045044ba9"
server_key_version: "encryptionkey@0"
I20260620 14:55:58.211125 14222 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:55:58.212533 14237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:58.212790 14222 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:58.212934 14222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "77ac149ae0d74a65b0597cf5767309e3"
format_stamp: "Formatted at 2026-06-20 14:55:58 on dist-test-slave-7v06"
server_key: "a0bd75e6e4d1a7c077877ca1ac4ea98d"
server_key_iv: "720126d83a6a1505fd3d967045044ba9"
server_key_version: "encryptionkey@0"
I20260620 14:55:58.213043 14222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:55:58.238127 14222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:55:58.241118 14222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:55:58.241341 14222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:55:58.241966 14222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:55:58.242043 14222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:55:58.242096 14222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:55:58.242129 14222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:58.250134 14222 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:33873
I20260620 14:55:58.250208 14352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:33873 every 8 connection(s)
I20260620 14:55:58.250537 14222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:55:58.253418 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.242645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:34575 (local address 127.12.116.190:40587)
0620 14:55:58.242733 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.242736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.242994 (+ 258us) server_negotiation.cc:407] Connection header received
0620 14:55:58.243631 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.243633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.243650 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.243739 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.244785 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.245716 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.247015 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.247374 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.247449 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.250146 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.250148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.250149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.250159 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.251841 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.252350 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.252351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.252352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.252421 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.252697 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.252698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.252699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.252853 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.252932 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.253227 (+ 295us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.253316 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260620 14:55:58.253654 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.242568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.12.116.131:34575)
0620 14:55:58.242786 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.242836 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.243465 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.243844 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.243849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.244325 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:58.244618 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.244647 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.245839 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.245841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.246879 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.246882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.247470 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.247471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.247660 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.248385 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:58.248395 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:58.250025 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:58.251962 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.251969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.251971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.252233 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.252490 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.252491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.252492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.252612 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.252921 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:58.252928 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:58.253081 (+ 153us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.253203 (+ 122us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.253385 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":123,"threads_started":1}
I20260620 14:55:58.254277 14353 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40587
I20260620 14:55:58.254395 14353 heartbeater.cc:464] Registering TS with master...
I20260620 14:55:58.254599 14353 heartbeater.cc:511] Master 127.12.116.190:40587 requested a full tablet report, sending...
I20260620 14:55:58.255093 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 14222
I20260620 14:55:58.255119 13869 ts_manager.cc:194] Registered new tserver with Master: 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873)
I20260620 14:55:58.255194 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:55:58.255360 12754 external_mini_cluster.cc:1428] Setting key 8a975fcccefb8dea5dad568b866483a7
I20260620 14:55:58.255721 13869 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:34575
I20260620 14:55:58.256282 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:55:58.262619 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.255565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:60337 (local address 127.12.116.190:40587)
0620 14:55:58.255639 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.255641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.255649 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:55:58.255727 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.255728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.255739 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.255784 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.256785 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.257274 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.258178 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.258370 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.258432 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.259552 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.259562 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.259563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.259571 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.261283 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.261824 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.261825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.261825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.261885 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.262109 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.262110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.262110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.262227 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.262281 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.262448 (+ 167us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.262515 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260620 14:55:58.262739 14359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.255412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.12.116.131:60337)
0620 14:55:58.255601 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.255611 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.255660 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.255799 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.255799 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.256035 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:58.256120 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.256122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.257391 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.257392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.258085 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.258088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.258450 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.258451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.258534 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.259108 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:58.259114 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:58.259447 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:58.261364 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.261366 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.261366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.261726 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.261966 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.261967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.261968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.262044 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.262293 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:58.262294 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:58.262353 (+ 59us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.262432 (+ 79us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.262566 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":71,"threads_started":1}
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:58.284628 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.275322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58106 (local address 127.12.116.190:40587)
0620 14:55:58.275663 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.275665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.275677 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:55:58.275709 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.275709 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.275721 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.275824 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.276717 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.277587 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.278536 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.278764 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.278835 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.281508 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.281511 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.281511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.281522 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.282983 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.283458 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.283459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.283460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.283594 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.283953 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.283955 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.283955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.284113 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.284208 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.284416 (+ 208us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.284556 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260620 14:55:58.286712 13869 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:55:58.288416 13869 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:55:58.296092 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.291329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46410 (local address 127.12.116.131:33873)
0620 14:55:58.291743 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.291749 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.291761 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:55:58.291801 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.291803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.291819 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.291937 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.292240 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.293643 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.294800 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.295600 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.295689 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.295752 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.295924 (+ 172us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.295971 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":119,"threads_started":1}
I20260620 14:55:58.296079 14370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.291196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:33873 (local address 127.0.0.1:46410)
0620 14:55:58.291344 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.291387 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.291466 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.292045 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.292048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.292051 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.292152 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.292155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.293738 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.293739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.294702 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.294706 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.295699 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.295700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.295790 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.295806 (+ 16us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.295896 (+ 90us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.295971 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":1,"thread_start_us":76,"threads_started":1}
I20260620 14:55:58.296226 14372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.291427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42703 (local address 127.0.0.1:33498)
0620 14:55:58.291570 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.291586 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.291666 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.292159 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.292160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.292163 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.292205 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.292206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.293708 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.293709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.295154 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.295157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.295954 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.295955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.296019 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.296023 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.296052 (+ 29us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.296091 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":109,"threads_started":1}
I20260620 14:55:58.296371 14374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.291635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43157 (local address 127.0.0.1:60036)
0620 14:55:58.291780 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.291790 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.291829 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.292287 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.292288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.292290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.292362 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.292364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.293280 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.293282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.294824 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.294832 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.296031 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.296032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.296102 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.296107 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.296175 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.296240 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
I20260620 14:55:58.296890 14373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.291557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.12.116.130:42703)
0620 14:55:58.291976 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.291981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.291991 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:55:58.292032 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.292034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.292049 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.292276 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.292360 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.293601 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.295253 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.295861 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.296136 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.296700 (+ 564us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.296729 (+ 29us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.296778 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":70,"threads_started":1}
I20260620 14:55:58.297286 14287 tablet_service.cc:1467] Processing CreateTablet for tablet ea2630851cae48f0885eb9ebb0d9319a (DEFAULT_TABLE table=test-table [id=7948c4e01b934886bcca4a4921eb1bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:58.297668 14287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea2630851cae48f0885eb9ebb0d9319a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.297605 14147 tablet_service.cc:1467] Processing CreateTablet for tablet ea2630851cae48f0885eb9ebb0d9319a (DEFAULT_TABLE table=test-table [id=7948c4e01b934886bcca4a4921eb1bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:58.297946 14147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea2630851cae48f0885eb9ebb0d9319a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.300673 14376 tablet_bootstrap.cc:492] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Bootstrap starting.
I20260620 14:55:58.300897 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.291770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60036 (local address 127.12.116.129:43157)
0620 14:55:58.291979 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.291984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.291994 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:55:58.292127 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.292130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.292146 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.292220 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.292428 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.293158 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.295052 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.295850 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.295942 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.295993 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.296493 (+ 500us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.296555 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
I20260620 14:55:58.301092 14377 tablet_bootstrap.cc:492] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Bootstrap starting.
I20260620 14:55:58.301754 14377 tablet_bootstrap.cc:654] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.301672 14007 tablet_service.cc:1467] Processing CreateTablet for tablet ea2630851cae48f0885eb9ebb0d9319a (DEFAULT_TABLE table=test-table [id=7948c4e01b934886bcca4a4921eb1bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:58.302081 14377 log.cc:824] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:58.302091 14007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea2630851cae48f0885eb9ebb0d9319a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.302181 14376 tablet_bootstrap.cc:654] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.302505 14376 log.cc:824] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:58.302883 14377 tablet_bootstrap.cc:492] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: No bootstrap required, opened a new log
I20260620 14:55:58.302960 14377 ts_tablet_manager.cc:1397] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:55:58.303534 14376 tablet_bootstrap.cc:492] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: No bootstrap required, opened a new log
I20260620 14:55:58.303609 14376 ts_tablet_manager.cc:1397] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:55:58.304876 14377 raft_consensus.cc:348] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.305047 14377 raft_consensus.cc:374] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.305091 14377 raft_consensus.cc:729] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387c3c0832404ad498fd99e28ba7d262, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.305248 14377 consensus_queue.cc:260] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.305576 14377 ts_tablet_manager.cc:1428] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 14:55:58.305619 14213 heartbeater.cc:503] Master 127.12.116.190:40587 was elected leader, sending a full tablet report...
I20260620 14:55:58.306301 14376 raft_consensus.cc:348] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.306509 14376 raft_consensus.cc:374] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.306564 14376 raft_consensus.cc:729] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ac149ae0d74a65b0597cf5767309e3, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.306715 14376 consensus_queue.cc:260] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.307027 14376 ts_tablet_manager.cc:1428] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:55:58.307107 14353 heartbeater.cc:503] Master 127.12.116.190:40587 was elected leader, sending a full tablet report...
W20260620 14:55:58.307437 14214 tablet.cc:2369] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:55:58.308431 14382 tablet_bootstrap.cc:492] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Bootstrap starting.
I20260620 14:55:58.309332 14382 tablet_bootstrap.cc:654] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.309700 14382 log.cc:824] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Log is configured to *not* fsync() on all Append() calls
I20260620 14:55:58.310611 14382 tablet_bootstrap.cc:492] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: No bootstrap required, opened a new log
I20260620 14:55:58.310691 14382 ts_tablet_manager.cc:1397] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:55:58.312220 14382 raft_consensus.cc:348] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.312486 14382 raft_consensus.cc:374] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.312520 14382 raft_consensus.cc:729] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e4784dea50a49db8bad1e74c925df85, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.312690 14382 consensus_queue.cc:260] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.313005 14382 ts_tablet_manager.cc:1428] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:55:58.313158 14073 heartbeater.cc:503] Master 127.12.116.190:40587 was elected leader, sending a full tablet report...
W20260620 14:55:58.381084 14074 tablet.cc:2369] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:55:58.401412 14381 raft_consensus.cc:482] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:55:58.401592 14381 raft_consensus.cc:504] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.401993 14381 leader_election.cc:288] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703), 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129:43157)
I20260620 14:55:58.405180 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.402467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:54383 (local address 127.12.116.129:43157)
0620 14:55:58.402535 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.402537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.402569 (+ 32us) server_negotiation.cc:407] Connection header received
0620 14:55:58.402655 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.402656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.402666 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.402734 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.402908 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.403438 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.404422 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.404790 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.404849 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.404857 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.405040 (+ 183us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.405092 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 14:55:58.405215 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.402193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42703 (local address 127.12.116.131:49737)
0620 14:55:58.402256 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.402271 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.402319 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.402537 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.402538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.402540 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.402676 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.402679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.403401 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.403402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.404274 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.404276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.404916 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.404917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.404995 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.405017 (+ 22us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.405077 (+ 60us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.405117 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":26}
I20260620 14:55:58.405215 14373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.402296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:49737 (local address 127.12.116.130:42703)
0620 14:55:58.402356 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.402359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.402370 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:55:58.402405 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.402406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.402416 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.402521 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.402773 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.403307 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.404421 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.404808 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.404907 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.404916 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.405095 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.405140 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 14:55:58.405239 14385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.402339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43157 (local address 127.12.116.131:54383)
0620 14:55:58.402509 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.402520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.402590 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.402764 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.402765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.402767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.402839 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.402841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.403523 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.403524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.404277 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.404279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.404873 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.404874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.404968 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.404971 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.405015 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.405048 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
I20260620 14:55:58.405661 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea2630851cae48f0885eb9ebb0d9319a" candidate_uuid: "77ac149ae0d74a65b0597cf5767309e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387c3c0832404ad498fd99e28ba7d262" is_pre_election: true
I20260620 14:55:58.405857 14167 raft_consensus.cc:2454] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77ac149ae0d74a65b0597cf5767309e3 in term 0.
I20260620 14:55:58.405958 14027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea2630851cae48f0885eb9ebb0d9319a" candidate_uuid: "77ac149ae0d74a65b0597cf5767309e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e4784dea50a49db8bad1e74c925df85" is_pre_election: true
I20260620 14:55:58.406100 14027 raft_consensus.cc:2454] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77ac149ae0d74a65b0597cf5767309e3 in term 0.
I20260620 14:55:58.406106 14240 leader_election.cc:302] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387c3c0832404ad498fd99e28ba7d262, 77ac149ae0d74a65b0597cf5767309e3; no voters:
I20260620 14:55:58.406265 14381 raft_consensus.cc:2781] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:55:58.406360 14381 raft_consensus.cc:482] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:55:58.406397 14381 raft_consensus.cc:3037] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.407619 14381 raft_consensus.cc:504] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.407799 14381 leader_election.cc:288] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [CANDIDATE]: Term 1 election: Requested vote from peers 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703), 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129:43157)
I20260620 14:55:58.408102 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea2630851cae48f0885eb9ebb0d9319a" candidate_uuid: "77ac149ae0d74a65b0597cf5767309e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387c3c0832404ad498fd99e28ba7d262"
I20260620 14:55:58.408102 14027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea2630851cae48f0885eb9ebb0d9319a" candidate_uuid: "77ac149ae0d74a65b0597cf5767309e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e4784dea50a49db8bad1e74c925df85"
I20260620 14:55:58.408202 14027 raft_consensus.cc:3037] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.408202 14167 raft_consensus.cc:3037] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.409308 14167 raft_consensus.cc:2454] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77ac149ae0d74a65b0597cf5767309e3 in term 1.
I20260620 14:55:58.409307 14027 raft_consensus.cc:2454] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77ac149ae0d74a65b0597cf5767309e3 in term 1.
I20260620 14:55:58.409545 14240 leader_election.cc:302] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387c3c0832404ad498fd99e28ba7d262, 77ac149ae0d74a65b0597cf5767309e3; no voters:
I20260620 14:55:58.409669 14381 raft_consensus.cc:2781] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:58.409842 14381 raft_consensus.cc:686] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 1 LEADER]: Becoming Leader. State: Replica: 77ac149ae0d74a65b0597cf5767309e3, State: Running, Role: LEADER
I20260620 14:55:58.409961 14381 consensus_queue.cc:237] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } }
I20260620 14:55:58.411043 13869 catalog_manager.cc:5495] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131). New cstate: current_term: 1 leader_uuid: "77ac149ae0d74a65b0597cf5767309e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } health_report { overall_health: UNKNOWN } } }
I20260620 14:55:58.447990 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.445176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46420 (local address 127.12.116.131:33873)
0620 14:55:58.445246 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.445248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.445259 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:55:58.445337 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.445341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.445360 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.445435 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:55:58.445632 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.446119 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.447045 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.447251 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.447330 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.447568 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:55:58.447690 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:55:58.447787 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.447846 (+ 59us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.447874 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 14:55:58.450378 14027 raft_consensus.cc:1261] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Refusing update from remote peer 77ac149ae0d74a65b0597cf5767309e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:55:58.450508 14167 raft_consensus.cc:1261] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Refusing update from remote peer 77ac149ae0d74a65b0597cf5767309e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:55:58.450767 14381 consensus_queue.cc:1035] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:55:58.450938 14386 consensus_queue.cc:1035] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:55:58.453790 14389 mvcc.cc:205] Tried to move back new op lower bound from 7298938300208914432 to 7298938300048080896. Current Snapshot: MvccSnapshot[applied={T|T < 7298938300208914432}]
I20260620 14:55:58.454841 14391 mvcc.cc:205] Tried to move back new op lower bound from 7298938300208914432 to 7298938300048080896. Current Snapshot: MvccSnapshot[applied={T|T < 7298938300208914432 or (T in {7298938300208914432})}]
I20260620 14:55:58.454814 14390 mvcc.cc:205] Tried to move back new op lower bound from 7298938300208914432 to 7298938300048080896. Current Snapshot: MvccSnapshot[applied={T|T < 7298938300208914432}]
I20260620 14:55:58.458418 13870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:55:58.458559 13870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:55:58.459705 13870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: Sending DeleteTablet for 3 replicas of tablet ea2630851cae48f0885eb9ebb0d9319a
I20260620 14:55:58.460309 14287 tablet_service.cc:1514] Processing DeleteTablet for tablet ea2630851cae48f0885eb9ebb0d9319a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:55:58 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:46410
I20260620 14:55:58.460413 14147 tablet_service.cc:1514] Processing DeleteTablet for tablet ea2630851cae48f0885eb9ebb0d9319a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:55:58 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:33498
I20260620 14:55:58.460462 14007 tablet_service.cc:1514] Processing DeleteTablet for tablet ea2630851cae48f0885eb9ebb0d9319a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:55:58 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60036
I20260620 14:55:58.460638 14399 tablet_replica.cc:330] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: stopping tablet replica
I20260620 14:55:58.460750 14399 raft_consensus.cc:2229] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:55:58.460909 14399 raft_consensus.cc:2258] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:55:58.460870 13870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:55:58.461086 13870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:55:58.461472 14400 tablet_replica.cc:330] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: stopping tablet replica
I20260620 14:55:58.461601 14400 raft_consensus.cc:2229] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:55:58.461611 14401 tablet_replica.cc:330] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: stopping tablet replica
I20260620 14:55:58.461738 14400 raft_consensus.cc:2258] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:55:58.461896 14401 raft_consensus.cc:2229] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:55:58.462031 14401 raft_consensus.cc:2258] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:55:58.463068 14007 tablet_service.cc:1467] Processing CreateTablet for tablet c5679de2938f43c58776a87b3e3595ad (DEFAULT_TABLE table=test-table [id=f4b4d9ee39cf4261b2c7c9a79ad196c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:58.463112 14400 ts_tablet_manager.cc:1905] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:55:58.463158 14401 ts_tablet_manager.cc:1905] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:55:58.463212 14007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5679de2938f43c58776a87b3e3595ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.464454 14147 tablet_service.cc:1467] Processing CreateTablet for tablet c5679de2938f43c58776a87b3e3595ad (DEFAULT_TABLE table=test-table [id=f4b4d9ee39cf4261b2c7c9a79ad196c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:58.464592 14147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5679de2938f43c58776a87b3e3595ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.465597 14382 tablet_bootstrap.cc:492] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Bootstrap starting.
I20260620 14:55:58.465972 14287 tablet_service.cc:1467] Processing CreateTablet for tablet c5679de2938f43c58776a87b3e3595ad (DEFAULT_TABLE table=test-table [id=f4b4d9ee39cf4261b2c7c9a79ad196c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:55:58.466081 14382 tablet_bootstrap.cc:654] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.466099 14287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5679de2938f43c58776a87b3e3595ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.467412 14401 ts_tablet_manager.cc:1918] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:55:58.467481 14401 log.cc:1196] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/ea2630851cae48f0885eb9ebb0d9319a
I20260620 14:55:58.468294 14401 ts_tablet_manager.cc:1939] T ea2630851cae48f0885eb9ebb0d9319a P 3e4784dea50a49db8bad1e74c925df85: Deleting consensus metadata
I20260620 14:55:58.468868 14376 tablet_bootstrap.cc:492] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Bootstrap starting.
I20260620 14:55:58.469321 14382 tablet_bootstrap.cc:492] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: No bootstrap required, opened a new log
I20260620 14:55:58.469383 14382 ts_tablet_manager.cc:1397] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260620 14:55:58.469517 14376 tablet_bootstrap.cc:654] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.470533 14382 raft_consensus.cc:348] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.470702 14382 raft_consensus.cc:374] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.470728 14382 raft_consensus.cc:729] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e4784dea50a49db8bad1e74c925df85, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.470750 13856 catalog_manager.cc:4841] TS 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129:43157): tablet ea2630851cae48f0885eb9ebb0d9319a (table test-table [id=7948c4e01b934886bcca4a4921eb1bf9]) successfully deleted
I20260620 14:55:58.470796 14382 consensus_queue.cc:260] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.470937 14382 ts_tablet_manager.cc:1428] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:55:58.471516 14399 ts_tablet_manager.cc:1905] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:55:58.471882 14377 tablet_bootstrap.cc:492] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Bootstrap starting.
I20260620 14:55:58.472289 14377 tablet_bootstrap.cc:654] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.472653 14400 ts_tablet_manager.cc:1918] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:55:58.472757 14400 log.cc:1196] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/ea2630851cae48f0885eb9ebb0d9319a
I20260620 14:55:58.473078 14400 ts_tablet_manager.cc:1939] T ea2630851cae48f0885eb9ebb0d9319a P 387c3c0832404ad498fd99e28ba7d262: Deleting consensus metadata
I20260620 14:55:58.473548 13856 catalog_manager.cc:4841] TS 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703): tablet ea2630851cae48f0885eb9ebb0d9319a (table test-table [id=7948c4e01b934886bcca4a4921eb1bf9]) successfully deleted
I20260620 14:55:58.473932 14399 ts_tablet_manager.cc:1918] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:55:58.474023 14399 log.cc:1196] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/ea2630851cae48f0885eb9ebb0d9319a
I20260620 14:55:58.474313 14399 ts_tablet_manager.cc:1939] T ea2630851cae48f0885eb9ebb0d9319a P 77ac149ae0d74a65b0597cf5767309e3: Deleting consensus metadata
I20260620 14:55:58.476004 14376 tablet_bootstrap.cc:492] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: No bootstrap required, opened a new log
I20260620 14:55:58.476115 14376 ts_tablet_manager.cc:1397] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260620 14:55:58.476387 14376 raft_consensus.cc:348] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.476529 14376 raft_consensus.cc:374] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.476560 14376 raft_consensus.cc:729] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ac149ae0d74a65b0597cf5767309e3, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.476620 14376 consensus_queue.cc:260] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.476732 14376 ts_tablet_manager.cc:1428] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:55:58.476730 13856 catalog_manager.cc:4841] TS 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873): tablet ea2630851cae48f0885eb9ebb0d9319a (table test-table [id=7948c4e01b934886bcca4a4921eb1bf9]) successfully deleted
I20260620 14:55:58.480945 14377 tablet_bootstrap.cc:492] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: No bootstrap required, opened a new log
I20260620 14:55:58.481050 14377 ts_tablet_manager.cc:1397] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260620 14:55:58.481235 14377 raft_consensus.cc:348] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.481333 14377 raft_consensus.cc:374] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.481369 14377 raft_consensus.cc:729] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387c3c0832404ad498fd99e28ba7d262, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.481428 14377 consensus_queue.cc:260] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.481547 14377 ts_tablet_manager.cc:1428] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260620 14:55:58.501192 14354 tablet.cc:2369] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:55:58.643971 14384 raft_consensus.cc:482] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:55:58.644090 14384 raft_consensus.cc:504] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.644546 14384 leader_election.cc:288] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703), 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873)
I20260620 14:55:58.648125 14405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.644942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42703 (local address 127.12.116.129:51697)
0620 14:55:58.645089 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.645102 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.645164 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.645482 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.645483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.645487 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.645559 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.645560 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.646252 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.646254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.647089 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.647092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.647831 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.647832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.647899 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.647903 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.647979 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.648026 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260620 14:55:58.648110 14373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.645126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:51697 (local address 127.12.116.130:42703)
0620 14:55:58.645290 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.645293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.645303 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:55:58.645335 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.645336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.645353 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.645428 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.645641 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.646125 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.647239 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.647723 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.647808 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.647820 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.647993 (+ 173us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.648036 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260620 14:55:58.648440 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.645348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:57439 (local address 127.12.116.131:33873)
0620 14:55:58.645443 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.645446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.645655 (+ 209us) server_negotiation.cc:407] Connection header received
0620 14:55:58.645732 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.645733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.645748 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.645827 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:55:58.646002 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.646483 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.647500 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.647958 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.648085 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.648094 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.648274 (+ 180us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.648359 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260620 14:55:58.648548 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5679de2938f43c58776a87b3e3595ad" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387c3c0832404ad498fd99e28ba7d262" is_pre_election: true
I20260620 14:55:58.648667 14167 raft_consensus.cc:2454] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 0.
I20260620 14:55:58.648871 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.645171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:33873 (local address 127.12.116.129:57439)
0620 14:55:58.645548 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.645563 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.645672 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.645845 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.645846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.645848 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:55:58.645926 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.645928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.646588 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.646589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.647402 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.647405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.648096 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.648098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.648178 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.648182 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.648538 (+ 356us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.648589 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":116,"threads_started":1}
I20260620 14:55:58.648881 13960 leader_election.cc:302] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387c3c0832404ad498fd99e28ba7d262, 3e4784dea50a49db8bad1e74c925df85; no voters:
I20260620 14:55:58.649178 14384 raft_consensus.cc:2781] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:55:58.649227 14384 raft_consensus.cc:482] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:55:58.649250 14384 raft_consensus.cc:3037] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.649289 14307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5679de2938f43c58776a87b3e3595ad" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac149ae0d74a65b0597cf5767309e3" is_pre_election: true
I20260620 14:55:58.649601 14307 raft_consensus.cc:2454] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 0.
I20260620 14:55:58.650522 14384 raft_consensus.cc:504] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.650861 14384 leader_election.cc:288] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 election: Requested vote from peers 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703), 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873)
I20260620 14:55:58.651226 14307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5679de2938f43c58776a87b3e3595ad" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac149ae0d74a65b0597cf5767309e3"
I20260620 14:55:58.651226 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5679de2938f43c58776a87b3e3595ad" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387c3c0832404ad498fd99e28ba7d262"
I20260620 14:55:58.651341 14167 raft_consensus.cc:3037] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.651341 14307 raft_consensus.cc:3037] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.652284 14167 raft_consensus.cc:2454] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 1.
I20260620 14:55:58.652284 14307 raft_consensus.cc:2454] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 1.
I20260620 14:55:58.652590 13960 leader_election.cc:302] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387c3c0832404ad498fd99e28ba7d262, 3e4784dea50a49db8bad1e74c925df85; no voters:
I20260620 14:55:58.652758 14384 raft_consensus.cc:2781] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:58.653052 14384 raft_consensus.cc:686] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 1 LEADER]: Becoming Leader. State: Replica: 3e4784dea50a49db8bad1e74c925df85, State: Running, Role: LEADER
I20260620 14:55:58.653165 14384 consensus_queue.cc:237] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.654681 13870 catalog_manager.cc:5495] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } health_report { overall_health: UNKNOWN } } }
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967357, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:55:58.729244 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.721280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40587 (local address 127.0.0.1:58110)
0620 14:55:58.721531 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.721548 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.721644 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.721813 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.721814 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.722203 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:55:58.722252 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.722254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.722926 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.722927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.723467 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.723469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.723859 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.723860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.723912 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.724536 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:55:58.724541 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:55:58.726102 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:55:58.727893 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.727903 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.727906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.728157 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.728437 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:55:58.728438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:55:58.728438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:55:58.728496 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:55:58.728855 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:55:58.728863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:55:58.728916 (+ 53us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.728997 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.729101 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":93,"threads_started":1}
I20260620 14:55:58.729244 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.721381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58110 (local address 127.12.116.190:40587)
0620 14:55:58.721497 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.721500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.721642 (+ 142us) server_negotiation.cc:407] Connection header received
0620 14:55:58.721713 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.721714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.721724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.721807 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.722337 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.722832 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.723556 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.723763 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.723858 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.726232 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.726234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.726234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.726241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.727790 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.728247 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.728248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.728248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.728306 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.728554 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.728555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.728555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.728716 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.728775 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.729072 (+ 297us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.729152 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":81}
I20260620 14:55:58.732731 13870 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:58110:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260620 14:55:58.733202 13870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:55:58.735441 14007 tablet_service.cc:1467] Processing CreateTablet for tablet 508a0abc87a04f8d8dd402b0f2e1de3c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=862ec53032064dcda3b6f21610514542]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:55:58.735435 14147 tablet_service.cc:1467] Processing CreateTablet for tablet 508a0abc87a04f8d8dd402b0f2e1de3c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=862ec53032064dcda3b6f21610514542]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:55:58.735441 14287 tablet_service.cc:1467] Processing CreateTablet for tablet 508a0abc87a04f8d8dd402b0f2e1de3c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=862ec53032064dcda3b6f21610514542]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:55:58.735639 14147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 508a0abc87a04f8d8dd402b0f2e1de3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.735639 14287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 508a0abc87a04f8d8dd402b0f2e1de3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.735778 14007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 508a0abc87a04f8d8dd402b0f2e1de3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:55:58.737335 14377 tablet_bootstrap.cc:492] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: Bootstrap starting.
I20260620 14:55:58.738329 14377 tablet_bootstrap.cc:654] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.738758 14376 tablet_bootstrap.cc:492] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: Bootstrap starting.
I20260620 14:55:58.739091 14377 tablet_bootstrap.cc:492] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: No bootstrap required, opened a new log
I20260620 14:55:58.739156 14377 ts_tablet_manager.cc:1397] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 14:55:58.739178 14376 tablet_bootstrap.cc:654] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.739337 14377 raft_consensus.cc:348] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.739442 14377 raft_consensus.cc:374] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.739464 14377 raft_consensus.cc:729] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387c3c0832404ad498fd99e28ba7d262, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.739477 14382 tablet_bootstrap.cc:492] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: Bootstrap starting.
I20260620 14:55:58.739513 14377 consensus_queue.cc:260] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.739638 14377 ts_tablet_manager.cc:1428] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260620 14:55:58.739751 14380 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.739885 14380 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.739974 14382 tablet_bootstrap.cc:654] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: Neither blocks nor log segments found. Creating new log.
I20260620 14:55:58.740924 14382 tablet_bootstrap.cc:492] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: No bootstrap required, opened a new log
I20260620 14:55:58.740995 14382 ts_tablet_manager.cc:1397] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:55:58.741176 14382 raft_consensus.cc:348] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.741248 14382 raft_consensus.cc:374] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.741222 14376 tablet_bootstrap.cc:492] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: No bootstrap required, opened a new log
I20260620 14:55:58.741263 14382 raft_consensus.cc:729] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e4784dea50a49db8bad1e74c925df85, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.741289 14376 ts_tablet_manager.cc:1397] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260620 14:55:58.741333 14382 consensus_queue.cc:260] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.741430 14382 ts_tablet_manager.cc:1428] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:55:58.741432 14376 raft_consensus.cc:348] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.741539 14376 raft_consensus.cc:374] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:55:58.741571 14376 raft_consensus.cc:729] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ac149ae0d74a65b0597cf5767309e3, State: Initialized, Role: FOLLOWER
I20260620 14:55:58.741576 14384 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.741645 14384 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.741667 14376 consensus_queue.cc:260] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.741786 14376 ts_tablet_manager.cc:1428] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:55:58.741888 14386 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.741955 14386 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.812150 14384 raft_consensus.cc:482] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:55:58.812261 14384 raft_consensus.cc:504] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.812486 14384 leader_election.cc:288] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703), 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873)
I20260620 14:55:58.812805 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "508a0abc87a04f8d8dd402b0f2e1de3c" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387c3c0832404ad498fd99e28ba7d262" is_pre_election: true
I20260620 14:55:58.812923 14167 raft_consensus.cc:2454] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 0.
I20260620 14:55:58.812901 14307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "508a0abc87a04f8d8dd402b0f2e1de3c" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac149ae0d74a65b0597cf5767309e3" is_pre_election: true
I20260620 14:55:58.813035 14307 raft_consensus.cc:2454] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 0.
I20260620 14:55:58.813122 13960 leader_election.cc:302] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387c3c0832404ad498fd99e28ba7d262, 3e4784dea50a49db8bad1e74c925df85; no voters:
I20260620 14:55:58.813221 14384 raft_consensus.cc:2781] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:55:58.813254 14384 raft_consensus.cc:482] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:55:58.813288 14384 raft_consensus.cc:3037] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.814256 14384 raft_consensus.cc:504] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.814445 14384 leader_election.cc:288] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 election: Requested vote from peers 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703), 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873)
I20260620 14:55:58.814901 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "508a0abc87a04f8d8dd402b0f2e1de3c" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387c3c0832404ad498fd99e28ba7d262"
I20260620 14:55:58.814922 14307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "508a0abc87a04f8d8dd402b0f2e1de3c" candidate_uuid: "3e4784dea50a49db8bad1e74c925df85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac149ae0d74a65b0597cf5767309e3"
I20260620 14:55:58.815017 14167 raft_consensus.cc:3037] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.815016 14307 raft_consensus.cc:3037] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:55:58.815670 14167 raft_consensus.cc:2454] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 1.
I20260620 14:55:58.815701 14307 raft_consensus.cc:2454] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e4784dea50a49db8bad1e74c925df85 in term 1.
I20260620 14:55:58.815899 13960 leader_election.cc:302] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387c3c0832404ad498fd99e28ba7d262, 3e4784dea50a49db8bad1e74c925df85; no voters:
I20260620 14:55:58.816051 14384 raft_consensus.cc:2781] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:55:58.816118 14384 raft_consensus.cc:686] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [term 1 LEADER]: Becoming Leader. State: Replica: 3e4784dea50a49db8bad1e74c925df85, State: Running, Role: LEADER
I20260620 14:55:58.816180 14384 consensus_queue.cc:237] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } }
I20260620 14:55:58.816609 14407 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: TxnStatusTablet state changed. Reason: New leader 3e4784dea50a49db8bad1e74c925df85. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.816706 14407 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:55:58.816885 14419 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 14:55:58.817121 14419 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 14:55:58.817190 13868 catalog_manager.cc:5495] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } health_report { overall_health: UNKNOWN } } }
I20260620 14:55:58.837877 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.834996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43157 (local address 127.0.0.1:60050)
0620 14:55:58.835083 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.835095 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.835149 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.835364 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.835365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.835366 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:55:58.835423 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.835425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.836135 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.836137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.836867 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.836869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.837276 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.837298 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.837354 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.837373 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:55:58.837673 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:55:58.837683 (+ 10us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.837737 (+ 54us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.837794 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260620 14:55:58.837877 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.835084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.12.116.129:43157)
0620 14:55:58.835167 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.835170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.835182 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:55:58.835239 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.835240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.835269 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.835341 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:55:58.835503 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.836033 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.836971 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.837194 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.837277 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.837486 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:55:58.837602 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:55:58.837690 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.837764 (+ 74us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.837786 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:55:58.839159 14167 raft_consensus.cc:1261] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Refusing update from remote peer 3e4784dea50a49db8bad1e74c925df85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:55:58.839277 14307 raft_consensus.cc:1261] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Refusing update from remote peer 3e4784dea50a49db8bad1e74c925df85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:55:58.839612 14384 consensus_queue.cc:1035] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:55:58.839784 14407 consensus_queue.cc:1035] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:55:58.840525 14380 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: TxnStatusTablet state changed. Reason: New leader 3e4784dea50a49db8bad1e74c925df85. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.840648 14380 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.840680 14386 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: TxnStatusTablet state changed. Reason: New leader 3e4784dea50a49db8bad1e74c925df85. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.840762 14386 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.841473 14384 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.841565 14384 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:55:58.842341 14380 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.842439 14380 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 387c3c0832404ad498fd99e28ba7d262: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.842993 14384 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.843091 14384 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 3e4784dea50a49db8bad1e74c925df85: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:55:58.843789 14386 tablet_replica.cc:439] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e4784dea50a49db8bad1e74c925df85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e4784dea50a49db8bad1e74c925df85" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43157 } } peers { permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 } } peers { permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 } } }
I20260620 14:55:58.843901 14386 tablet_replica.cc:442] T 508a0abc87a04f8d8dd402b0f2e1de3c P 77ac149ae0d74a65b0597cf5767309e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:55:58.846580 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.843420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60052 (local address 127.12.116.129:43157)
0620 14:55:58.843458 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.843460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.843468 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:55:58.843489 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.843490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.843501 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.843548 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:55:58.844146 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.844766 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.845903 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.846093 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.846162 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.846323 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:55:58.846353 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:55:58.846390 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.846467 (+ 77us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.846483 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 14:55:58.853513 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.850493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:45951 (local address 127.12.116.129:43157)
0620 14:55:58.850543 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.850544 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.850710 (+ 166us) server_negotiation.cc:407] Connection header received
0620 14:55:58.850787 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.850788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.850798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.850864 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:55:58.851026 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.851525 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.852739 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.852933 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.853009 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.853208 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:55:58.853249 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:55:58.853310 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.853361 (+ 51us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.853381 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 14:55:58.853528 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.850388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43157 (local address 127.12.116.129:45951)
0620 14:55:58.850617 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0620 14:55:58.850640 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0620 14:55:58.850725 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:55:58.850867 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:55:58.850868 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:55:58.850869 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:55:58.850942 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.850944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.851831 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.851832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.852651 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:55:58.852654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.853020 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.853021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:55:58.853107 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.853127 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:55:58.853310 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:55:58.853312 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 14:55:58.853360 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 14:55:58.853402 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260620 14:55:58.857645 14307 raft_consensus.cc:1261] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Refusing update from remote peer 3e4784dea50a49db8bad1e74c925df85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:55:58.857573 14167 raft_consensus.cc:1261] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Refusing update from remote peer 3e4784dea50a49db8bad1e74c925df85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:55:58.857873 14384 consensus_queue.cc:1035] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77ac149ae0d74a65b0597cf5767309e3" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 33873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:55:58.857998 14407 consensus_queue.cc:1035] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387c3c0832404ad498fd99e28ba7d262" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:55:58.873968 13870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:55:58.874130 13870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:55:58.875176 13870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aa3eb80e05a4a36b555c91eb09adf7b: Sending DeleteTablet for 3 replicas of tablet c5679de2938f43c58776a87b3e3595ad
I20260620 14:55:58.875475 14007 tablet_service.cc:1514] Processing DeleteTablet for tablet c5679de2938f43c58776a87b3e3595ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:55:58 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60036
I20260620 14:55:58.875495 14147 tablet_service.cc:1514] Processing DeleteTablet for tablet c5679de2938f43c58776a87b3e3595ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:55:58 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:33498
I20260620 14:55:58.875586 14401 tablet_replica.cc:330] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: stopping tablet replica
I20260620 14:55:58.875643 14401 raft_consensus.cc:2229] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:55:58.875763 14401 raft_consensus.cc:2258] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:55:58.875861 14400 tablet_replica.cc:330] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: stopping tablet replica
I20260620 14:55:58.875921 14400 raft_consensus.cc:2229] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:55:58.875964 14400 raft_consensus.cc:2258] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:55:58.876227 14401 ts_tablet_manager.cc:1905] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:55:58.876252 14400 ts_tablet_manager.cc:1905] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:55:58.876386 14287 tablet_service.cc:1514] Processing DeleteTablet for tablet c5679de2938f43c58776a87b3e3595ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:55:58 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:46410
I20260620 14:55:58.876489 14399 tablet_replica.cc:330] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: stopping tablet replica
I20260620 14:55:58.876544 14399 raft_consensus.cc:2229] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:55:58.876581 14399 raft_consensus.cc:2258] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:55:58.878398 14399 ts_tablet_manager.cc:1905] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:55:58.878875 14401 ts_tablet_manager.cc:1918] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:55:58.878875 14400 ts_tablet_manager.cc:1918] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:55:58.878939 14400 log.cc:1196] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/c5679de2938f43c58776a87b3e3595ad
I20260620 14:55:58.878939 14401 log.cc:1196] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/c5679de2938f43c58776a87b3e3595ad
I20260620 14:55:58.879173 14401 ts_tablet_manager.cc:1939] T c5679de2938f43c58776a87b3e3595ad P 3e4784dea50a49db8bad1e74c925df85: Deleting consensus metadata
I20260620 14:55:58.879179 14400 ts_tablet_manager.cc:1939] T c5679de2938f43c58776a87b3e3595ad P 387c3c0832404ad498fd99e28ba7d262: Deleting consensus metadata
I20260620 14:55:58.879608 13856 catalog_manager.cc:4841] TS 3e4784dea50a49db8bad1e74c925df85 (127.12.116.129:43157): tablet c5679de2938f43c58776a87b3e3595ad (table test-table [id=f4b4d9ee39cf4261b2c7c9a79ad196c6]) successfully deleted
I20260620 14:55:58.880319 13856 catalog_manager.cc:4841] TS 387c3c0832404ad498fd99e28ba7d262 (127.12.116.130:42703): tablet c5679de2938f43c58776a87b3e3595ad (table test-table [id=f4b4d9ee39cf4261b2c7c9a79ad196c6]) successfully deleted
I20260620 14:55:58.881143 14399 ts_tablet_manager.cc:1918] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:55:58.881212 14399 log.cc:1196] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/c5679de2938f43c58776a87b3e3595ad
I20260620 14:55:58.881448 14399 ts_tablet_manager.cc:1939] T c5679de2938f43c58776a87b3e3595ad P 77ac149ae0d74a65b0597cf5767309e3: Deleting consensus metadata
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[13825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967358, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:55:58.884899 13856 catalog_manager.cc:4841] TS 77ac149ae0d74a65b0597cf5767309e3 (127.12.116.131:33873): tablet c5679de2938f43c58776a87b3e3595ad (table test-table [id=f4b4d9ee39cf4261b2c7c9a79ad196c6]) successfully deleted
I20260620 14:55:58.889003 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.877970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60054 (local address 127.12.116.129:43157)
0620 14:55:58.878017 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.878019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.878028 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:55:58.878053 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.878054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.878064 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.878137 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.879405 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.880140 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.881315 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.881619 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.881664 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.885708 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.885716 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.885716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.885724 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.887565 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.888072 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.888076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.888076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.888140 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.888402 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.888403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.888403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.888582 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.888705 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.888810 (+ 105us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.888889 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260620 14:55:58.889396 14067 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60054
I20260620 14:55:58.901593 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:55:58.892287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58116 (local address 127.12.116.190:40587)
0620 14:55:58.892404 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0620 14:55:58.892407 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:55:58.892426 (+ 19us) server_negotiation.cc:407] Connection header received
0620 14:55:58.892554 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:55:58.892555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:55:58.892568 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:55:58.892625 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:55:58.893694 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.894238 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.894974 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:55:58.895196 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:55:58.895279 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:55:58.898118 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:55:58.898120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:55:58.898120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:55:58.898262 (+ 142us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:55:58.899989 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.900644 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.900646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.900646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.900721 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:55:58.900959 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:55:58.900960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:55:58.900960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:55:58.901115 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:55:58.901245 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0620 14:55:58.901372 (+ 127us) server_negotiation.cc:299] Negotiation successful
0620 14:55:58.901471 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260620 14:55:58.901952 13870 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58116
I20260620 14:55:58.902941 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13942
I20260620 14:55:58.910818 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 14082
I20260620 14:55:58.917482 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 14222
I20260620 14:55:58.924492 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 13838
2026-06-20T14:55:58Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2699 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[14438](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[14438](info): set up 2 sockets
Jun 20 14:55:58 dist-test-slave-7v06 krb5kdc[14438](info): commencing operation
krb5kdc: starting...
W20260620 14:56:00.060714 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:00.217674 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:41773
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:41773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:00.316454 14451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:00.316766 14451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:00.316797 14451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:00.318663 14451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:00.318805 14451 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260620 14:56:00.318823 14451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:00.318838 14451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:00.318856 14451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:00.318869 14451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:00.322295 14451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:41773
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:41773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:00.322791 14451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:00.323140 14451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:00.330708 14457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:00.330797 14456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:00.331007 14459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:00.330807 14451 server_base.cc:1034] running on GCE node
I20260620 14:56:00.331465 14451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:00.331908 14451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:00.333117 14451 hybrid_clock.cc:648] HybridClock initialized: now 1781967360333091 us; error 44 us; skew 500 ppm
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:00.336643 14451 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:00.337289 14451 webserver.cc:460] Webserver started at http://127.12.116.190:44473/ using document root <none> and password file <none>
I20260620 14:56:00.337579 14451 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:00.337641 14451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:00.337795 14451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:00.339030 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "630d4791929b48a4a213ecf1e4ba264c"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "6788ee93c30b5512da559475dbec5ac1"
server_key_iv: "ec5490dc2b82753a1e107132823ead77"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.339438 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "630d4791929b48a4a213ecf1e4ba264c"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "6788ee93c30b5512da559475dbec5ac1"
server_key_iv: "ec5490dc2b82753a1e107132823ead77"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.342700 14451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260620 14:56:00.345314 14466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:00.345960 14451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:00.346110 14451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "630d4791929b48a4a213ecf1e4ba264c"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "6788ee93c30b5512da559475dbec5ac1"
server_key_iv: "ec5490dc2b82753a1e107132823ead77"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.346292 14451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:00.373266 14451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:00.376108 14451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:00.376256 14451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:00.383037 14451 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:41773
I20260620 14:56:00.383185 14528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:41773 every 8 connection(s)
I20260620 14:56:00.383661 14451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:00.384498 14529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:00.385347 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 14451
I20260620 14:56:00.385452 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:00.385635 12754 external_mini_cluster.cc:1428] Setting key 4da2c4b9e9217f38f07fbe5ff1c670eb
I20260620 14:56:00.388669 14529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Bootstrap starting.
I20260620 14:56:00.389379 14529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:00.389716 14529 log.cc:824] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:00.390686 14529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: No bootstrap required, opened a new log
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:00.394430 14529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "630d4791929b48a4a213ecf1e4ba264c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41773 } }
I20260620 14:56:00.394685 14529 raft_consensus.cc:374] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:00.394733 14529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630d4791929b48a4a213ecf1e4ba264c, State: Initialized, Role: FOLLOWER
I20260620 14:56:00.394912 14529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "630d4791929b48a4a213ecf1e4ba264c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41773 } }
I20260620 14:56:00.395025 14529 raft_consensus.cc:388] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:00.395960 14529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:00.397493 14529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:00.398749 14529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "630d4791929b48a4a213ecf1e4ba264c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41773 } }
I20260620 14:56:00.398921 14529 leader_election.cc:302] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 630d4791929b48a4a213ecf1e4ba264c; no voters:
I20260620 14:56:00.399160 14529 leader_election.cc:288] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:00.399274 14534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:00.399474 14529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:00.399569 14534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [term 1 LEADER]: Becoming Leader. State: Replica: 630d4791929b48a4a213ecf1e4ba264c, State: Running, Role: LEADER
I20260620 14:56:00.399700 14534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "630d4791929b48a4a213ecf1e4ba264c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41773 } }
I20260620 14:56:00.400096 14535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "630d4791929b48a4a213ecf1e4ba264c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "630d4791929b48a4a213ecf1e4ba264c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41773 } } }
I20260620 14:56:00.400189 14535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:00.400404 14536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 630d4791929b48a4a213ecf1e4ba264c. Latest consensus state: current_term: 1 leader_uuid: "630d4791929b48a4a213ecf1e4ba264c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "630d4791929b48a4a213ecf1e4ba264c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41773 } } }
I20260620 14:56:00.400660 14536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:00.400838 14542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:00.401419 14542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:00.402768 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.386364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42694 (local address 127.12.116.190:41773)
0620 14:56:00.386597 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:00.386609 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:00.386648 (+ 39us) server_negotiation.cc:407] Connection header received
0620 14:56:00.387275 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:00.387283 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:00.387352 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:00.387810 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:00.388618 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.389733 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.391013 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.391677 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.391823 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.394677 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:00.394682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:00.394682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:00.394698 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:00.399769 (+ 5071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.400419 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.400423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.400423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.400580 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.400849 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.400850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.400851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.401272 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:00.401874 (+ 602us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:00.402172 (+ 298us) server_negotiation.cc:299] Negotiation successful
0620 14:56:00.402559 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":116,"threads_started":1}
I20260620 14:56:00.404875 14542 catalog_manager.cc:1347] Generated new cluster ID: b4cc0439da834902bfd57be144ecb420
I20260620 14:56:00.404954 14542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:00.415321 14542 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:00.415948 14542 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:00.422371 14542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Generated new TSK 0
I20260620 14:56:00.422646 14542 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:00.481130 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41773
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:00.582108 14555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:00.582451 14555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:00.582508 14555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:00.583925 14555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:00.584018 14555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:00.584056 14555 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260620 14:56:00.584095 14555 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:56:00.584133 14555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:00.586205 14555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:41773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:00.586591 14555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:00.586875 14555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:00.594265 14561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:00.594281 14563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:00.595073 14560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:00.596490 14555 server_base.cc:1034] running on GCE node
I20260620 14:56:00.596805 14555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:00.597157 14555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:00.598454 14555 hybrid_clock.cc:648] HybridClock initialized: now 1781967360598348 us; error 111 us; skew 500 ppm
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:00.603058 14555 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:00.603696 14555 webserver.cc:460] Webserver started at http://127.12.116.129:39493/ using document root <none> and password file <none>
I20260620 14:56:00.603987 14555 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:00.604463 14555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:00.604671 14555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:00.606036 14555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "08967013ba3f462dafe27d4b68f79f5c"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "6a89360e8760b7f70422563a1dcbc8ce"
server_key_iv: "a65ddaf8cd15ebb6dade289db1275504"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.606496 14555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "08967013ba3f462dafe27d4b68f79f5c"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "6a89360e8760b7f70422563a1dcbc8ce"
server_key_iv: "a65ddaf8cd15ebb6dade289db1275504"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.608582 14555 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 14:56:00.610059 14570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:00.610430 14555 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:00.610708 14555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "08967013ba3f462dafe27d4b68f79f5c"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "6a89360e8760b7f70422563a1dcbc8ce"
server_key_iv: "a65ddaf8cd15ebb6dade289db1275504"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.610850 14555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:00.648909 14555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:00.652427 14555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:00.652629 14555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:00.653219 14555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:00.653293 14555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:00.653331 14555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:00.653350 14555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:00.662786 14555 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:36597
I20260620 14:56:00.662832 14685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:36597 every 8 connection(s)
I20260620 14:56:00.663219 14555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:00.666937 14579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.653773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.12.116.129:42205)
0620 14:56:00.654001 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:00.654049 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:00.654824 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:00.655173 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:00.655178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:00.655662 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:00.656230 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.656240 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.657496 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.657498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.659085 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.659090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.659571 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.659573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.659763 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.660619 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:00.660641 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:00.662844 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:00.665317 (+ 2473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.665326 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.665328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.665630 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.665893 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.665894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.665894 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.666027 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.666321 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:00.666326 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:00.666462 (+ 136us) client_negotiation.cc:769] Sending connection context
0620 14:56:00.666555 (+ 93us) client_negotiation.cc:240] Negotiation successful
0620 14:56:00.666705 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":129,"threads_started":1}
I20260620 14:56:00.667034 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.653788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:42205 (local address 127.12.116.190:41773)
0620 14:56:00.653907 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:00.653911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:00.654169 (+ 258us) server_negotiation.cc:407] Connection header received
0620 14:56:00.654967 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:00.654969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:00.654981 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:00.655067 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:00.656435 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.657343 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.659213 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.659455 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.659546 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.662990 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:00.662992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:00.662993 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:00.663004 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:00.665189 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.665723 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.665725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.665725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.665790 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.666124 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.666125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.666125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.666253 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:00.666319 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:00.666697 (+ 378us) server_negotiation.cc:299] Negotiation successful
0620 14:56:00.666888 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260620 14:56:00.667790 14686 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41773
I20260620 14:56:00.667896 14686 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:00.668107 14686 heartbeater.cc:511] Master 127.12.116.190:41773 requested a full tablet report, sending...
I20260620 14:56:00.668824 14483 ts_manager.cc:194] Registered new tserver with Master: 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597)
I20260620 14:56:00.669701 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 14555
I20260620 14:56:00.669800 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:00.669829 14483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:42205
I20260620 14:56:00.669986 12754 external_mini_cluster.cc:1428] Setting key 40a31c24ad4a9ddd2e087c1037e1e2e4
I20260620 14:56:00.676935 14692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.668960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.12.116.129:44103)
0620 14:56:00.669153 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:00.669163 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:00.669226 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:00.669374 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:00.669375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:00.669591 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:00.669670 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.669672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.670711 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.670712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.671583 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.671587 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.672235 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.672239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.672407 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.673312 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:00.673317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:00.673684 (+ 367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:00.675704 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.675705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.675706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.675912 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.676146 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.676147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.676147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.676221 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.676532 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:00.676533 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:00.676616 (+ 83us) client_negotiation.cc:769] Sending connection context
0620 14:56:00.676694 (+ 78us) client_negotiation.cc:240] Negotiation successful
0620 14:56:00.676817 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":84,"threads_started":1}
I20260620 14:56:00.676924 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.669023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:44103 (local address 127.12.116.190:41773)
0620 14:56:00.669098 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:00.669100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:00.669227 (+ 127us) server_negotiation.cc:407] Connection header received
0620 14:56:00.669284 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:00.669284 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:00.669294 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:00.669345 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:00.669731 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.670470 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.671725 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.671939 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.672144 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.673830 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:00.673831 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:00.673832 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:00.673839 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:00.675592 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.675994 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.675995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.675996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.676068 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.676288 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.676289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.676289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.676448 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:00.676527 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:00.676719 (+ 192us) server_negotiation.cc:299] Negotiation successful
0620 14:56:00.676816 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:00.705277 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41773
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:00.806347 14695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:00.806609 14695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:00.806638 14695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:00.808858 14695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:00.809072 14695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:00.809401 14695 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260620 14:56:00.809530 14695 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:56:00.809568 14695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:00.812531 14695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:41773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:00.812834 14695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:00.813057 14695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:00.820887 14703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:00.820891 14701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:00.820887 14700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:00.820922 14695 server_base.cc:1034] running on GCE node
I20260620 14:56:00.821558 14695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:00.821842 14695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:00.823103 14695 hybrid_clock.cc:648] HybridClock initialized: now 1781967360823009 us; error 133 us; skew 500 ppm
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:00.827250 14695 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:00.827839 14695 webserver.cc:460] Webserver started at http://127.12.116.130:44703/ using document root <none> and password file <none>
I20260620 14:56:00.828118 14695 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:00.828199 14695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:00.828428 14695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:00.829636 14695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "6a315c588aad4cccb1241109d31a4b04"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "b630612e2d77ff4e94a92a3f5ad49626"
server_key_iv: "76407c38c7afe5400ac01d87df1609d0"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.830065 14695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "6a315c588aad4cccb1241109d31a4b04"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "b630612e2d77ff4e94a92a3f5ad49626"
server_key_iv: "76407c38c7afe5400ac01d87df1609d0"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.832248 14695 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:00.833760 14710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:00.834242 14695 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:00.834395 14695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6a315c588aad4cccb1241109d31a4b04"
format_stamp: "Formatted at 2026-06-20 14:56:00 on dist-test-slave-7v06"
server_key: "b630612e2d77ff4e94a92a3f5ad49626"
server_key_iv: "76407c38c7afe5400ac01d87df1609d0"
server_key_version: "encryptionkey@0"
I20260620 14:56:00.834498 14695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:00.860041 14695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:00.863258 14695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:00.863464 14695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:00.864188 14695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:00.864250 14695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:00.864284 14695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:00.864300 14695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:56:00 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:00.874663 14695 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:43301
I20260620 14:56:00.875099 14825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:43301 every 8 connection(s)
I20260620 14:56:00.875157 14695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:00.880302 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.864757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:57263 (local address 127.12.116.190:41773)
0620 14:56:00.864833 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:00.864836 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:00.865142 (+ 306us) server_negotiation.cc:407] Connection header received
0620 14:56:00.865877 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:00.865878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:00.865890 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:00.865989 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:00.867054 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.867950 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.869349 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.869809 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.869923 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.874760 (+ 4837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:00.874763 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:00.874763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:00.874774 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:00.878300 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.878908 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.878909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.878909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.878979 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.879310 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.879311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.879311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.879556 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:00.879635 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:00.880059 (+ 424us) server_negotiation.cc:299] Negotiation successful
0620 14:56:00.880146 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 14:56:00.880661 14719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.864723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.12.116.130:57263)
0620 14:56:00.864933 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:00.864990 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:00.865741 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:00.866107 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:00.866113 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:00.866566 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:00.866911 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.866918 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.868042 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.868042 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.869179 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.869183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.870029 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.870031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.870478 (+ 447us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.871443 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:00.871455 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:00.874586 (+ 3131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:00.878479 (+ 3893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.878487 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.878490 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.878787 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.879090 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.879090 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.879091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.879210 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.879708 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:00.879715 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:00.879867 (+ 152us) client_negotiation.cc:769] Sending connection context
0620 14:56:00.879977 (+ 110us) client_negotiation.cc:240] Negotiation successful
0620 14:56:00.880151 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":126,"threads_started":1}
I20260620 14:56:00.882055 14826 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41773
I20260620 14:56:00.882375 14826 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:00.882567 14826 heartbeater.cc:511] Master 127.12.116.190:41773 requested a full tablet report, sending...
I20260620 14:56:00.883021 14482 ts_manager.cc:194] Registered new tserver with Master: 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130:43301)
I20260620 14:56:00.883666 14482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:57263
I20260620 14:56:00.884789 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 14695
I20260620 14:56:00.884876 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:00.885094 12754 external_mini_cluster.cc:1428] Setting key 9c1a4b04075dd564be83001570febc0c
I20260620 14:56:00.895550 14832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.882783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.12.116.130:49023)
0620 14:56:00.882956 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:00.882969 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:00.883048 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:00.883384 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:00.883385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:00.883616 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:00.883696 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.883699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.884493 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.884494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.885252 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:00.885256 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.885850 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.885851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:00.885931 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.886826 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:00.886832 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:00.887373 (+ 541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:00.893968 (+ 6595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.893971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.893972 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.894256 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.894591 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:00.894592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:00.894593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:00.894666 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:00.895222 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:00.895223 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:00.895289 (+ 66us) client_negotiation.cc:769] Sending connection context
0620 14:56:00.895354 (+ 65us) client_negotiation.cc:240] Negotiation successful
0620 14:56:00.895461 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260620 14:56:00.895671 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:00.882850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:49023 (local address 127.12.116.190:41773)
0620 14:56:00.882924 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:00.882926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:00.883092 (+ 166us) server_negotiation.cc:407] Connection header received
0620 14:56:00.883138 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:00.883140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:00.883252 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:00.883343 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:00.883833 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.884384 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.885429 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:00.885754 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:00.885831 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:00.888293 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:00.888295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:00.888295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:00.888306 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:00.893817 (+ 5511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.894365 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.894367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.894367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.894449 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:00.894744 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:00.894746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:00.894746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:00.895028 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:00.895122 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:00.895412 (+ 290us) server_negotiation.cc:299] Negotiation successful
0620 14:56:00.895533 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:00.933982 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41773
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:01.034020 14835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:01.034330 14835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:01.034365 14835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:01.036080 14835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:01.036150 14835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:01.036175 14835 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260620 14:56:01.036188 14835 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:56:01.036209 14835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:01.038309 14835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:41773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:01.038575 14835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:01.038987 14835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:01.045316 14840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:01.045292 14841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:01.045298 14843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:01.045892 14835 server_base.cc:1034] running on GCE node
I20260620 14:56:01.046164 14835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:01.046468 14835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:01.047708 14835 hybrid_clock.cc:648] HybridClock initialized: now 1781967361047684 us; error 57 us; skew 500 ppm
Jun 20 14:56:01 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967361, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:01.050858 14835 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:01.051342 14835 webserver.cc:460] Webserver started at http://127.12.116.131:44117/ using document root <none> and password file <none>
I20260620 14:56:01.051546 14835 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:01.051705 14835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:01.051853 14835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:01.053061 14835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "2e17af71c2404d6c928fd06838f3d465"
format_stamp: "Formatted at 2026-06-20 14:56:01 on dist-test-slave-7v06"
server_key: "4f2f9d21b3940ca8ab6973eb49040a02"
server_key_iv: "2a652bf877b39e5cada3d325f7610095"
server_key_version: "encryptionkey@0"
I20260620 14:56:01.053423 14835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "2e17af71c2404d6c928fd06838f3d465"
format_stamp: "Formatted at 2026-06-20 14:56:01 on dist-test-slave-7v06"
server_key: "4f2f9d21b3940ca8ab6973eb49040a02"
server_key_iv: "2a652bf877b39e5cada3d325f7610095"
server_key_version: "encryptionkey@0"
I20260620 14:56:01.055032 14835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 14:56:01.055923 14850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:01.056253 14835 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:01.056422 14835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "2e17af71c2404d6c928fd06838f3d465"
format_stamp: "Formatted at 2026-06-20 14:56:01 on dist-test-slave-7v06"
server_key: "4f2f9d21b3940ca8ab6973eb49040a02"
server_key_iv: "2a652bf877b39e5cada3d325f7610095"
server_key_version: "encryptionkey@0"
I20260620 14:56:01.056516 14835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:01.068225 14835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:01.071727 14835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:01.071954 14835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:01.072685 14835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:01.072749 14835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:01.072793 14835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:01.072814 14835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:56:01 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967361, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:01.080641 14835 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:40697
I20260620 14:56:01.080734 14965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:40697 every 8 connection(s)
I20260620 14:56:01.081074 14835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:01.081699 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 14835
I20260620 14:56:01.081810 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:01.082031 12754 external_mini_cluster.cc:1428] Setting key 6505b70b99be2682814359c1632e2028
I20260620 14:56:01.084621 14859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.073285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.12.116.131:39107)
0620 14:56:01.073462 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.073505 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.074016 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.074296 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.074299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.074643 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:01.074966 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.074973 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.076090 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.076091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.077131 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.077134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.077592 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.077594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.077732 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.078377 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:01.078391 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:01.080855 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:01.083065 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:01.083071 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:01.083073 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:01.083316 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:01.083487 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:01.083487 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:01.083487 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:01.083585 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:01.083945 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:01.083951 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:01.084087 (+ 136us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.084183 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.084379 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":106,"threads_started":1}
I20260620 14:56:01.084622 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.073276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39107 (local address 127.12.116.190:41773)
0620 14:56:01.073361 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.073364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.073604 (+ 240us) server_negotiation.cc:407] Connection header received
0620 14:56:01.074122 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.074124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.074147 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.074237 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:01.075094 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.075949 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.077241 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.077464 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.077560 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.081026 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:01.081028 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:01.081028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:01.081040 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:01.082976 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.083386 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.083387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.083387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.083441 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.083694 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.083695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.083695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.083864 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:01.083935 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.084259 (+ 324us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.084556 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260620 14:56:01.085245 14966 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41773
I20260620 14:56:01.085342 14966 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:01.085546 14966 heartbeater.cc:511] Master 127.12.116.190:41773 requested a full tablet report, sending...
I20260620 14:56:01.085968 14482 ts_manager.cc:194] Registered new tserver with Master: 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:01.086440 14482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:39107
I20260620 14:56:01.094588 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:56:01.095217 14972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.086365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.12.116.131:49317)
0620 14:56:01.086522 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.086534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.086606 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.086760 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.086761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.086955 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:01.087023 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.087025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.088076 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.088077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.088721 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.088724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.089126 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.089127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.089215 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.089851 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:01.089856 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:01.090258 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:01.093080 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:01.093081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:01.093084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:01.093352 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:01.094053 (+ 701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:01.094056 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:01.094056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:01.094179 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:01.094834 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:01.094835 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:01.094921 (+ 86us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.095002 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.095123 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260620 14:56:01.095269 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.086453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:49317 (local address 127.12.116.190:41773)
0620 14:56:01.086503 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.086505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.086585 (+ 80us) server_negotiation.cc:407] Connection header received
0620 14:56:01.086675 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.086676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.086687 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.086732 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:01.087110 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.087937 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.088826 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.089034 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.089124 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.090385 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:01.090388 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:01.090388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:01.090398 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:01.092938 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.093431 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.093433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.093433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.093659 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.094472 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.094473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.094474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.094720 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:01.094810 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.095050 (+ 240us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.095157 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Jun 20 14:56:01 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 14:56:01 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:01.125731 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.113693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44736 (local address 127.12.116.190:41773)
0620 14:56:01.113778 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.113780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.113793 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:56:01.113891 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.113892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.113903 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.113992 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:01.114821 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.115456 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.116596 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.116810 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.116878 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.120242 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:01.120244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:01.120244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:01.120254 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:01.123307 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.124108 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.124110 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.124110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.124192 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.124741 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.124742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.124742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.124910 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:01.125015 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.125457 (+ 442us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.125624 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260620 14:56:01.129094 14482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:01.137902 14482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:01.146288 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.141906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57812 (local address 127.12.116.129:36597)
0620 14:56:01.142238 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.142243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.142255 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:01.142304 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.142307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.142323 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.142400 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.142585 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.143763 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.145168 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.145756 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.145864 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.145933 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.146117 (+ 184us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.146175 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":82,"threads_started":1}
I20260620 14:56:01.146277 14983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.141790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:36597 (local address 127.0.0.1:57812)
0620 14:56:01.141999 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.142045 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.142130 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.142402 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.142405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.142406 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.142494 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.142497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.143859 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.143860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.145055 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.145058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.145863 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.145864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.145962 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.145979 (+ 17us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.146094 (+ 115us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.146161 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
I20260620 14:56:01.146559 14985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.141904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40697 (local address 127.0.0.1:32964)
0620 14:56:01.142128 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.142140 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.142196 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.142525 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.142526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.142528 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.142591 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.142592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.143559 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.143560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.145110 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.145112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.146119 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.146120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.146194 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.146202 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.146235 (+ 33us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.146284 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":89,"threads_started":1}
I20260620 14:56:01.147168 14986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.141999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32964 (local address 127.12.116.131:40697)
0620 14:56:01.142336 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.142341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.142351 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:01.142399 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.142402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.142419 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.142669 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.142724 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.143452 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.145207 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.146012 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.146341 (+ 329us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.146982 (+ 641us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.147013 (+ 31us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.147066 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":101,"threads_started":1}
I20260620 14:56:01.147192 14620 tablet_service.cc:1467] Processing CreateTablet for tablet 5243d4484037484c82fa14a0168b486b (DEFAULT_TABLE table=test-table [id=af594aaf87eb41f3ac6e767d733f1efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:01.151443 14988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.142340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54004 (local address 127.12.116.130:43301)
0620 14:56:01.142532 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.142536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.142546 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:01.142582 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.142583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.142598 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.142671 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.142870 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.143938 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.145225 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.146005 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.146108 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.146171 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.146474 (+ 303us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.146532 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":82,"threads_started":1}
I20260620 14:56:01.151520 14987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.142102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43301 (local address 127.0.0.1:54004)
0620 14:56:01.142272 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.142281 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.142319 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.142731 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.142732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.142734 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.142792 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.142794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.144050 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.144051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.145108 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.145126 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.146202 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.146203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.146274 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.146277 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.146324 (+ 47us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.146363 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":83,"threads_started":1}
I20260620 14:56:01.153044 14620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5243d4484037484c82fa14a0168b486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.154640 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 5243d4484037484c82fa14a0168b486b (DEFAULT_TABLE table=test-table [id=af594aaf87eb41f3ac6e767d733f1efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:01.154649 14760 tablet_service.cc:1467] Processing CreateTablet for tablet 5243d4484037484c82fa14a0168b486b (DEFAULT_TABLE table=test-table [id=af594aaf87eb41f3ac6e767d733f1efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:01.155094 14760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5243d4484037484c82fa14a0168b486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.157980 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5243d4484037484c82fa14a0168b486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.162557 14989 tablet_bootstrap.cc:492] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Bootstrap starting.
I20260620 14:56:01.162963 14990 tablet_bootstrap.cc:492] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Bootstrap starting.
I20260620 14:56:01.163455 14991 tablet_bootstrap.cc:492] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Bootstrap starting.
I20260620 14:56:01.163836 14989 tablet_bootstrap.cc:654] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.164054 14990 tablet_bootstrap.cc:654] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.164271 14991 tablet_bootstrap.cc:654] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.164284 14989 log.cc:824] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:01.164422 14990 log.cc:824] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:01.164702 14991 log.cc:824] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:01.165239 14990 tablet_bootstrap.cc:492] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: No bootstrap required, opened a new log
I20260620 14:56:01.165243 14989 tablet_bootstrap.cc:492] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: No bootstrap required, opened a new log
I20260620 14:56:01.165335 14990 ts_tablet_manager.cc:1397] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:01.165362 14989 ts_tablet_manager.cc:1397] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:56:01.166940 14990 raft_consensus.cc:348] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.166996 14989 raft_consensus.cc:348] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.167145 14989 raft_consensus.cc:374] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.167164 14990 raft_consensus.cc:374] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.167210 14990 raft_consensus.cc:729] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17af71c2404d6c928fd06838f3d465, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.167387 14990 consensus_queue.cc:260] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.167168 14989 raft_consensus.cc:729] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08967013ba3f462dafe27d4b68f79f5c, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.167722 14989 consensus_queue.cc:260] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.168025 14989 ts_tablet_manager.cc:1428] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:56:01.168176 14686 heartbeater.cc:503] Master 127.12.116.190:41773 was elected leader, sending a full tablet report...
I20260620 14:56:01.168706 14991 tablet_bootstrap.cc:492] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: No bootstrap required, opened a new log
I20260620 14:56:01.168853 14991 ts_tablet_manager.cc:1397] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260620 14:56:01.171437 14991 raft_consensus.cc:348] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.171960 14991 raft_consensus.cc:374] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.172036 14991 raft_consensus.cc:729] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.172191 14991 consensus_queue.cc:260] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.172607 14991 ts_tablet_manager.cc:1428] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260620 14:56:01.172607 14826 heartbeater.cc:503] Master 127.12.116.190:41773 was elected leader, sending a full tablet report...
I20260620 14:56:01.172497 14990 ts_tablet_manager.cc:1428] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260620 14:56:01.173473 14966 heartbeater.cc:503] Master 127.12.116.190:41773 was elected leader, sending a full tablet report...
W20260620 14:56:01.332180 14967 tablet.cc:2369] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:56:01.376783 14827 tablet.cc:2369] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:56:01.414392 14687 tablet.cc:2369] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:01.583022 14997 raft_consensus.cc:482] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:01.583216 14997 raft_consensus.cc:504] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.583727 14997 leader_election.cc:288] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697), 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597)
I20260620 14:56:01.587052 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.584065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:47817 (local address 127.12.116.129:36597)
0620 14:56:01.584119 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.584121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.584195 (+ 74us) server_negotiation.cc:407] Connection header received
0620 14:56:01.584259 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.584260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.584272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.584371 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.584552 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.585053 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.586175 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.586632 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.586728 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.586739 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.586917 (+ 178us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.586966 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 14:56:01.587093 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.584012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40697 (local address 127.12.116.130:33753)
0620 14:56:01.584175 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.584186 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.584260 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.584460 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.584461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.584463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.584552 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.584553 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.585375 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.585377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.586124 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.586126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.586760 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.586761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.586855 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.586859 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.586931 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.586982 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":72,"threads_started":1}
I20260620 14:56:01.587074 14986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.584141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:33753 (local address 127.12.116.131:40697)
0620 14:56:01.584206 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.584208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.584241 (+ 33us) server_negotiation.cc:407] Connection header received
0620 14:56:01.584362 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.584363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.584374 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.584457 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.584630 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.585280 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.586231 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.586648 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.586758 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.586767 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.586942 (+ 175us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.586982 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 14:56:01.587113 14998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.583969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:36597 (local address 127.12.116.130:47817)
0620 14:56:01.584101 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.584114 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.584196 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.584380 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.584381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.584383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.584471 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.584473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.585174 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.585175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.586053 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.586056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.586727 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.586728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.586814 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.586818 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.586898 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.586955 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
I20260620 14:56:01.587967 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5243d4484037484c82fa14a0168b486b" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465" is_pre_election: true
I20260620 14:56:01.588647 14920 raft_consensus.cc:2454] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:01.588559 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5243d4484037484c82fa14a0168b486b" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c" is_pre_election: true
I20260620 14:56:01.589345 14640 raft_consensus.cc:2454] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:01.589541 14712 leader_election.cc:302] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e17af71c2404d6c928fd06838f3d465, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:01.589924 14997 raft_consensus.cc:2781] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:01.589993 14997 raft_consensus.cc:482] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:01.590019 14997 raft_consensus.cc:3037] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:01.595317 14997 raft_consensus.cc:504] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.595624 14997 leader_election.cc:288] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Requested vote from peers 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697), 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597)
I20260620 14:56:01.595887 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5243d4484037484c82fa14a0168b486b" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465"
I20260620 14:56:01.596016 14920 raft_consensus.cc:3037] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:01.597193 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5243d4484037484c82fa14a0168b486b" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c"
I20260620 14:56:01.597337 14640 raft_consensus.cc:3037] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:01.597846 14920 raft_consensus.cc:2454] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:01.598208 14712 leader_election.cc:302] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e17af71c2404d6c928fd06838f3d465, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:01.598383 14997 raft_consensus.cc:2781] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:01.598408 14640 raft_consensus.cc:2454] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:01.598539 14997 raft_consensus.cc:686] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Becoming Leader. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Running, Role: LEADER
I20260620 14:56:01.598788 14997 consensus_queue.cc:237] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } }
I20260620 14:56:01.600564 14482 catalog_manager.cc:5495] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6a315c588aad4cccb1241109d31a4b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } health_report { overall_health: UNKNOWN } } }
Jun 20 14:56:01 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967360, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:01.744129 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.734006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41773 (local address 127.0.0.1:44742)
0620 14:56:01.734310 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.734322 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.734380 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.734889 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.734890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.735222 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:01.735277 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.735279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.736438 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.736440 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.737798 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.737803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.738312 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.738313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.738365 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.739221 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:01.739227 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:01.740846 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:01.742797 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:01.742809 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:01.742812 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:01.743054 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:01.743375 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:01.743376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:01.743376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:01.743432 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:01.743794 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:01.743802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:01.743852 (+ 50us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.743920 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.744040 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":225,"threads_started":1}
I20260620 14:56:01.744242 15008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.734171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44742 (local address 127.12.116.190:41773)
0620 14:56:01.734341 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.734342 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.734368 (+ 26us) server_negotiation.cc:407] Connection header received
0620 14:56:01.734709 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.734710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.734722 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.734807 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:01.735422 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.736256 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.737945 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.738199 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.738279 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.741050 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:01.741051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:01.741052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:01.741059 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:01.742645 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.743172 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.743173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.743173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.743243 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:01.743543 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:01.743545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:01.743545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:01.743693 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:01.743764 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.743981 (+ 217us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.744105 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":138,"thread_start_us":113,"threads_started":1}
I20260620 14:56:01.747112 14482 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:44742:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260620 14:56:01.747452 14482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:01.751809 14620 tablet_service.cc:1467] Processing CreateTablet for tablet 918cd2278e1c4bd8aaf7105e229ff52e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a42f64702527487881ed11bf50f3dbbd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:56:01.752043 14620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918cd2278e1c4bd8aaf7105e229ff52e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.751931 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 918cd2278e1c4bd8aaf7105e229ff52e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a42f64702527487881ed11bf50f3dbbd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:56:01.751928 14760 tablet_service.cc:1467] Processing CreateTablet for tablet 918cd2278e1c4bd8aaf7105e229ff52e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a42f64702527487881ed11bf50f3dbbd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:56:01.752400 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918cd2278e1c4bd8aaf7105e229ff52e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.752400 14760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918cd2278e1c4bd8aaf7105e229ff52e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.755113 15009 tablet_bootstrap.cc:492] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: Bootstrap starting.
I20260620 14:56:01.755776 15009 tablet_bootstrap.cc:654] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.756608 15012 tablet_bootstrap.cc:492] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: Bootstrap starting.
I20260620 14:56:01.756732 15009 tablet_bootstrap.cc:492] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: No bootstrap required, opened a new log
I20260620 14:56:01.756776 15009 ts_tablet_manager.cc:1397] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:01.757141 15009 raft_consensus.cc:348] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.757272 15009 raft_consensus.cc:374] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.757303 15009 raft_consensus.cc:729] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08967013ba3f462dafe27d4b68f79f5c, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.757344 15012 tablet_bootstrap.cc:654] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.757441 15009 consensus_queue.cc:260] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.757687 15009 ts_tablet_manager.cc:1428] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:01.754943 15010 tablet_bootstrap.cc:492] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: Bootstrap starting.
I20260620 14:56:01.757947 15013 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.758054 15013 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.758363 15010 tablet_bootstrap.cc:654] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.758667 15012 tablet_bootstrap.cc:492] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: No bootstrap required, opened a new log
I20260620 14:56:01.758744 15012 ts_tablet_manager.cc:1397] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:01.758929 15012 raft_consensus.cc:348] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.759032 15012 raft_consensus.cc:374] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.759056 15012 raft_consensus.cc:729] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.759119 15012 consensus_queue.cc:260] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.759260 15012 ts_tablet_manager.cc:1428] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:56:01.759371 15000 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.759485 15000 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.759699 15010 tablet_bootstrap.cc:492] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: No bootstrap required, opened a new log
I20260620 14:56:01.759779 15010 ts_tablet_manager.cc:1397] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260620 14:56:01.759980 15010 raft_consensus.cc:348] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.760070 15010 raft_consensus.cc:374] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.760087 15010 raft_consensus.cc:729] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17af71c2404d6c928fd06838f3d465, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.760150 15010 consensus_queue.cc:260] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.760376 15010 ts_tablet_manager.cc:1428] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:01.760516 15016 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.760648 15016 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.767280 15016 raft_consensus.cc:482] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:01.768150 15016 raft_consensus.cc:504] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.768688 15016 leader_election.cc:288] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130:43301)
I20260620 14:56:01.774200 15018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.769020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43301 (local address 127.12.116.131:34135)
0620 14:56:01.769239 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.769253 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.769323 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.769771 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.769772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.769774 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.769825 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.769826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.771110 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.771111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.772398 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.772403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.773872 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.773873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.773962 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.773966 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.774034 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.774094 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":116,"threads_started":1}
I20260620 14:56:01.774200 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.769274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:34135 (local address 127.12.116.130:43301)
0620 14:56:01.769626 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.769628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.769639 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:01.769673 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.769673 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.769682 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.769771 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.769907 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.770978 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.772608 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.773763 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.773872 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.773884 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.774064 (+ 180us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.774110 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":207,"threads_started":1}
I20260620 14:56:01.774824 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.768956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:59923 (local address 127.12.116.129:36597)
0620 14:56:01.769006 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.769009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.769293 (+ 284us) server_negotiation.cc:407] Connection header received
0620 14:56:01.769331 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.769332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.769343 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.769407 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:01.769899 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.770450 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.773426 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.773879 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.774136 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.774155 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.774665 (+ 510us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.774742 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:01.774963 14779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918cd2278e1c4bd8aaf7105e229ff52e" candidate_uuid: "2e17af71c2404d6c928fd06838f3d465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a315c588aad4cccb1241109d31a4b04" is_pre_election: true
I20260620 14:56:01.775166 15017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.768863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:36597 (local address 127.12.116.131:59923)
0620 14:56:01.769116 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.769129 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.769220 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.769663 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.769664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.769667 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:01.769754 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.769756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.770545 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.770547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.773060 (+ 2513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.773063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.774138 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.774140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.774256 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.774261 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.774402 (+ 141us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.774478 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":81,"threads_started":1}
I20260620 14:56:01.775192 14779 raft_consensus.cc:2454] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e17af71c2404d6c928fd06838f3d465 in term 0.
I20260620 14:56:01.775954 14852 leader_election.cc:302] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e17af71c2404d6c928fd06838f3d465, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:01.776012 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918cd2278e1c4bd8aaf7105e229ff52e" candidate_uuid: "2e17af71c2404d6c928fd06838f3d465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c" is_pre_election: true
I20260620 14:56:01.776135 14640 raft_consensus.cc:2454] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e17af71c2404d6c928fd06838f3d465 in term 0.
I20260620 14:56:01.776209 15016 raft_consensus.cc:2781] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:01.776244 15016 raft_consensus.cc:482] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:01.776268 15016 raft_consensus.cc:3037] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:01.777410 15016 raft_consensus.cc:504] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.777704 15016 leader_election.cc:288] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [CANDIDATE]: Term 1 election: Requested vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130:43301)
I20260620 14:56:01.777803 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918cd2278e1c4bd8aaf7105e229ff52e" candidate_uuid: "2e17af71c2404d6c928fd06838f3d465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c"
I20260620 14:56:01.777889 14640 raft_consensus.cc:3037] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:01.777859 14779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918cd2278e1c4bd8aaf7105e229ff52e" candidate_uuid: "2e17af71c2404d6c928fd06838f3d465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a315c588aad4cccb1241109d31a4b04"
I20260620 14:56:01.778038 14779 raft_consensus.cc:3037] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:01.778697 14640 raft_consensus.cc:2454] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e17af71c2404d6c928fd06838f3d465 in term 1.
I20260620 14:56:01.778878 14779 raft_consensus.cc:2454] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e17af71c2404d6c928fd06838f3d465 in term 1.
I20260620 14:56:01.778929 14853 leader_election.cc:302] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08967013ba3f462dafe27d4b68f79f5c, 2e17af71c2404d6c928fd06838f3d465; no voters:
I20260620 14:56:01.779201 15016 raft_consensus.cc:2781] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:01.779426 15016 raft_consensus.cc:686] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [term 1 LEADER]: Becoming Leader. State: Replica: 2e17af71c2404d6c928fd06838f3d465, State: Running, Role: LEADER
I20260620 14:56:01.779609 15016 consensus_queue.cc:237] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.780488 15020 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: TxnStatusTablet state changed. Reason: New leader 2e17af71c2404d6c928fd06838f3d465. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.780628 15020 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:56:01.780864 15022 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 14:56:01.781014 15022 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 14:56:01.781152 14483 catalog_manager.cc:5495] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131). New cstate: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } health_report { overall_health: HEALTHY } } }
I20260620 14:56:01.798149 14986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.795433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32968 (local address 127.12.116.131:40697)
0620 14:56:01.795505 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.795507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.795518 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:01.795615 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.795616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.795644 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.795717 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:01.795884 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.796438 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.797265 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.797467 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.797562 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.797763 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.797879 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.797976 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.798017 (+ 41us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.798040 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260620 14:56:01.798161 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.795346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40697 (local address 127.0.0.1:32968)
0620 14:56:01.795439 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.795450 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.795531 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.795725 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.795726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.795727 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:01.795792 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.795794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.796523 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.796524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.797169 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.797171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.797557 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.797559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.797618 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.797645 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.797948 (+ 303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.797958 (+ 10us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.798010 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.798080 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 14:56:01.800207 14640 raft_consensus.cc:1261] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Refusing update from remote peer 2e17af71c2404d6c928fd06838f3d465: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:01.800343 14779 raft_consensus.cc:1261] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Refusing update from remote peer 2e17af71c2404d6c928fd06838f3d465: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:01.800683 15020 consensus_queue.cc:1035] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:01.800846 15016 consensus_queue.cc:1035] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:01.802397 15013 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: TxnStatusTablet state changed. Reason: New leader 2e17af71c2404d6c928fd06838f3d465. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.802502 15013 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.803226 15000 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: TxnStatusTablet state changed. Reason: New leader 2e17af71c2404d6c928fd06838f3d465. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.803349 15000 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.804145 15016 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.804245 15016 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:56:01.804288 15016 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.804354 15016 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 2e17af71c2404d6c928fd06838f3d465: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:56:01.804401 15013 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.804489 15013 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 08967013ba3f462dafe27d4b68f79f5c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.805045 15026 mvcc.cc:205] Tried to move back new op lower bound from 7298938313930145792 to 7298938313850634240. Current Snapshot: MvccSnapshot[applied={T|T < 7298938313930145792}]
I20260620 14:56:01.805751 15000 tablet_replica.cc:439] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e17af71c2404d6c928fd06838f3d465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } } }
I20260620 14:56:01.805857 15000 tablet_replica.cc:442] T 918cd2278e1c4bd8aaf7105e229ff52e P 6a315c588aad4cccb1241109d31a4b04: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:01.806138 15028 mvcc.cc:205] Tried to move back new op lower bound from 7298938313930145792 to 7298938313850634240. Current Snapshot: MvccSnapshot[applied={T|T < 7298938313930145792 or (T in {7298938313930145792})}]
I20260620 14:56:01.811201 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.806862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.12.116.130:43301)
0620 14:56:01.806908 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.806910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.807001 (+ 91us) server_negotiation.cc:407] Connection header received
0620 14:56:01.807093 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.807094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.807109 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.807173 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:01.807295 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.808187 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.809950 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.810200 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.810300 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.810525 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.810693 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.810780 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.810852 (+ 72us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.811011 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:01.822173 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.818952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40697 (local address 127.12.116.130:48935)
0620 14:56:01.819136 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.819150 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.819215 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.819365 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.819366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.819367 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:01.819434 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.819436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.820448 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.820450 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.821098 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.821100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.821620 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.821621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.821690 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.821713 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.821974 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.821977 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.822034 (+ 57us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.822085 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":112,"threads_started":1}
I20260620 14:56:01.822170 14986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.819037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:48935 (local address 127.12.116.131:40697)
0620 14:56:01.819128 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.819131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.819204 (+ 73us) server_negotiation.cc:407] Connection header received
0620 14:56:01.819273 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.819273 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.819285 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.819362 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:01.819497 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.820262 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.821202 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.821513 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.821594 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.821834 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.821874 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.821931 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.822057 (+ 126us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.822085 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 14:56:01.826109 14640 raft_consensus.cc:1261] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:01.826195 14920 raft_consensus.cc:1261] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:01.826668 14997 consensus_queue.cc:1035] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:01.826872 14997 consensus_queue.cc:1035] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:01.829787 15025 mvcc.cc:205] Tried to move back new op lower bound from 7298938314034868224 to 7298938313109803008. Current Snapshot: MvccSnapshot[applied={T|T < 7298938314034868224}]
I20260620 14:56:01.846493 15043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.842951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43301 (local address 127.12.116.131:44661)
0620 14:56:01.843503 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:01.843515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:01.843582 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:01.843743 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:01.843744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:01.843745 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:01.843824 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.843826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.844540 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.844541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.845414 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:01.845417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.845969 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.845970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:01.846050 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.846071 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.846308 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.846311 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:01.846354 (+ 43us) client_negotiation.cc:240] Negotiation successful
0620 14:56:01.846402 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":114,"threads_started":1}
I20260620 14:56:01.846738 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:01.843511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:44661 (local address 127.12.116.130:43301)
0620 14:56:01.843559 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:01.843561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:01.843570 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:01.843650 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:01.843651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:01.843668 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:01.843739 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:01.843895 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.844457 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.845513 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:01.845826 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:01.845924 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:01.846165 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:01.846208 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:01.846278 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:01.846601 (+ 323us) server_negotiation.cc:299] Negotiation successful
0620 14:56:01.846652 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 14:56:01.871819 14483 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:01.871984 14483 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:01.873839 14483 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Sending DeleteTablet for 3 replicas of tablet 5243d4484037484c82fa14a0168b486b
I20260620 14:56:01.874912 14760 tablet_service.cc:1514] Processing DeleteTablet for tablet 5243d4484037484c82fa14a0168b486b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:01 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54004
I20260620 14:56:01.874898 14620 tablet_service.cc:1514] Processing DeleteTablet for tablet 5243d4484037484c82fa14a0168b486b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:01 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:57812
I20260620 14:56:01.877592 15047 tablet_replica.cc:330] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: stopping tablet replica
I20260620 14:56:01.877763 15047 raft_consensus.cc:2229] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:01.877830 15047 raft_consensus.cc:2258] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:01.877885 14483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:56:01.878430 15047 ts_tablet_manager.cc:1905] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 14:56:01.878486 14483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:01.879467 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 5243d4484037484c82fa14a0168b486b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:01 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:32964
I20260620 14:56:01.880368 15048 tablet_replica.cc:330] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: stopping tablet replica
I20260620 14:56:01.880538 15048 raft_consensus.cc:2229] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:01.880637 15048 raft_consensus.cc:2258] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:01.881099 15048 ts_tablet_manager.cc:1905] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:01.881389 14620 tablet_service.cc:1467] Processing CreateTablet for tablet 7e211ac408724417960d74e0fa65db4c (DEFAULT_TABLE table=test-table [id=8bedabba53c646b79e28a908333e7fd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:01.881532 14620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e211ac408724417960d74e0fa65db4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.884006 15009 tablet_bootstrap.cc:492] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Bootstrap starting.
I20260620 14:56:01.884063 14760 tablet_service.cc:1467] Processing CreateTablet for tablet 7e211ac408724417960d74e0fa65db4c (DEFAULT_TABLE table=test-table [id=8bedabba53c646b79e28a908333e7fd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:01.884188 14760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e211ac408724417960d74e0fa65db4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.884503 15048 ts_tablet_manager.cc:1918] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:01.884541 15009 tablet_bootstrap.cc:654] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.884656 15048 log.cc:1196] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/5243d4484037484c82fa14a0168b486b
I20260620 14:56:01.885088 15048 ts_tablet_manager.cc:1939] T 5243d4484037484c82fa14a0168b486b P 2e17af71c2404d6c928fd06838f3d465: Deleting consensus metadata
I20260620 14:56:01.885541 15012 tablet_bootstrap.cc:492] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Bootstrap starting.
I20260620 14:56:01.885620 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 7e211ac408724417960d74e0fa65db4c (DEFAULT_TABLE table=test-table [id=8bedabba53c646b79e28a908333e7fd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:01.885670 14468 catalog_manager.cc:4841] TS 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697): tablet 5243d4484037484c82fa14a0168b486b (table test-table [id=af594aaf87eb41f3ac6e767d733f1efe]) successfully deleted
I20260620 14:56:01.885727 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e211ac408724417960d74e0fa65db4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:01.885923 15046 tablet_replica.cc:330] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: stopping tablet replica
I20260620 14:56:01.886045 15012 tablet_bootstrap.cc:654] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.886188 15046 raft_consensus.cc:2229] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:01.886359 15046 raft_consensus.cc:2258] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:01.887048 15010 tablet_bootstrap.cc:492] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Bootstrap starting.
I20260620 14:56:01.887254 15046 ts_tablet_manager.cc:1905] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:01.888315 15010 tablet_bootstrap.cc:654] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:01.894120 15047 ts_tablet_manager.cc:1918] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:01.894268 15047 log.cc:1196] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/5243d4484037484c82fa14a0168b486b
I20260620 14:56:01.894804 15047 ts_tablet_manager.cc:1939] T 5243d4484037484c82fa14a0168b486b P 08967013ba3f462dafe27d4b68f79f5c: Deleting consensus metadata
I20260620 14:56:01.897132 14469 catalog_manager.cc:4841] TS 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597): tablet 5243d4484037484c82fa14a0168b486b (table test-table [id=af594aaf87eb41f3ac6e767d733f1efe]) successfully deleted
I20260620 14:56:01.897747 15012 tablet_bootstrap.cc:492] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: No bootstrap required, opened a new log
I20260620 14:56:01.897833 15012 ts_tablet_manager.cc:1397] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260620 14:56:01.897922 15046 ts_tablet_manager.cc:1918] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:01.898015 15046 log.cc:1196] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/5243d4484037484c82fa14a0168b486b
I20260620 14:56:01.898066 15012 raft_consensus.cc:348] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.898186 15012 raft_consensus.cc:374] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.898211 15012 raft_consensus.cc:729] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.898278 15012 consensus_queue.cc:260] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.898368 15046 ts_tablet_manager.cc:1939] T 5243d4484037484c82fa14a0168b486b P 6a315c588aad4cccb1241109d31a4b04: Deleting consensus metadata
I20260620 14:56:01.898408 15012 ts_tablet_manager.cc:1428] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:01.899432 15009 tablet_bootstrap.cc:492] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: No bootstrap required, opened a new log
I20260620 14:56:01.899509 15009 ts_tablet_manager.cc:1397] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20260620 14:56:01.899701 15009 raft_consensus.cc:348] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.899802 15009 raft_consensus.cc:374] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.899832 15009 raft_consensus.cc:729] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08967013ba3f462dafe27d4b68f79f5c, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.899886 15009 consensus_queue.cc:260] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.899986 15009 ts_tablet_manager.cc:1428] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260620 14:56:01.900846 15010 tablet_bootstrap.cc:492] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: No bootstrap required, opened a new log
I20260620 14:56:01.900913 15010 ts_tablet_manager.cc:1397] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260620 14:56:01.901082 15010 raft_consensus.cc:348] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.901168 15010 raft_consensus.cc:374] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:01.901192 15010 raft_consensus.cc:729] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17af71c2404d6c928fd06838f3d465, State: Initialized, Role: FOLLOWER
I20260620 14:56:01.901163 14468 catalog_manager.cc:4841] TS 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130:43301): tablet 5243d4484037484c82fa14a0168b486b (table test-table [id=af594aaf87eb41f3ac6e767d733f1efe]) successfully deleted
I20260620 14:56:01.901242 15010 consensus_queue.cc:260] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:01.901358 15010 ts_tablet_manager.cc:1428] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:02.014649 15041 raft_consensus.cc:482] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:02.014789 15041 raft_consensus.cc:504] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:02.014997 15041 leader_election.cc:288] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:02.015398 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e211ac408724417960d74e0fa65db4c" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c" is_pre_election: true
I20260620 14:56:02.015393 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e211ac408724417960d74e0fa65db4c" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465" is_pre_election: true
I20260620 14:56:02.015529 14640 raft_consensus.cc:2454] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:02.015584 14920 raft_consensus.cc:2454] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:02.015802 14713 leader_election.cc:302] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08967013ba3f462dafe27d4b68f79f5c, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:02.015944 15041 raft_consensus.cc:2781] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:02.015977 15041 raft_consensus.cc:482] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:02.015998 15041 raft_consensus.cc:3037] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:02.017128 15041 raft_consensus.cc:504] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:02.017315 15041 leader_election.cc:288] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Requested vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:02.017566 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e211ac408724417960d74e0fa65db4c" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c"
I20260620 14:56:02.017674 14640 raft_consensus.cc:3037] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:02.017879 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e211ac408724417960d74e0fa65db4c" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465"
I20260620 14:56:02.017998 14920 raft_consensus.cc:3037] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:02.018585 14640 raft_consensus.cc:2454] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:02.018798 14920 raft_consensus.cc:2454] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:02.018802 14713 leader_election.cc:302] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08967013ba3f462dafe27d4b68f79f5c, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:02.018890 15041 raft_consensus.cc:2781] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:02.018937 15041 raft_consensus.cc:686] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Becoming Leader. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Running, Role: LEADER
I20260620 14:56:02.018992 15041 consensus_queue.cc:237] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:02.020040 14483 catalog_manager.cc:5495] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6a315c588aad4cccb1241109d31a4b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:02.041728 14640 raft_consensus.cc:1261] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:02.041939 14920 raft_consensus.cc:1261] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:02.042021 15041 consensus_queue.cc:1035] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:02.042379 15041 consensus_queue.cc:1035] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:56:02.048260 15028 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260620 14:56:03.587364 14482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:03.587503 14482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:03.589313 14482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Sending DeleteTablet for 3 replicas of tablet 7e211ac408724417960d74e0fa65db4c
I20260620 14:56:03.589864 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e211ac408724417960d74e0fa65db4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:03 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:32964
I20260620 14:56:03.589962 14760 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e211ac408724417960d74e0fa65db4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:03 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54004
I20260620 14:56:03.589962 14620 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e211ac408724417960d74e0fa65db4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:03 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:57812
I20260620 14:56:03.590534 15076 tablet_replica.cc:330] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: stopping tablet replica
I20260620 14:56:03.590643 15076 raft_consensus.cc:2229] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:03.590703 15076 raft_consensus.cc:2258] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:03.590837 15075 tablet_replica.cc:330] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: stopping tablet replica
I20260620 14:56:03.591130 15075 raft_consensus.cc:2229] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:03.591270 15075 raft_consensus.cc:2258] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:03.591817 15076 ts_tablet_manager.cc:1905] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:03.592592 15075 ts_tablet_manager.cc:1905] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:03.594861 15075 ts_tablet_manager.cc:1918] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 14:56:03.594957 15075 log.cc:1196] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/7e211ac408724417960d74e0fa65db4c
I20260620 14:56:03.595240 15075 ts_tablet_manager.cc:1939] T 7e211ac408724417960d74e0fa65db4c P 6a315c588aad4cccb1241109d31a4b04: Deleting consensus metadata
I20260620 14:56:03.595819 15077 tablet_replica.cc:330] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: stopping tablet replica
I20260620 14:56:03.595919 15077 raft_consensus.cc:2229] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:03.596001 14468 catalog_manager.cc:4841] TS 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130:43301): tablet 7e211ac408724417960d74e0fa65db4c (table test-table [id=8bedabba53c646b79e28a908333e7fd1]) successfully deleted
I20260620 14:56:03.596055 15077 raft_consensus.cc:2258] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:03.596470 15077 ts_tablet_manager.cc:1905] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:03.597465 15076 ts_tablet_manager.cc:1918] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 14:56:03.597572 15076 log.cc:1196] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/7e211ac408724417960d74e0fa65db4c
I20260620 14:56:03.597829 15076 ts_tablet_manager.cc:1939] T 7e211ac408724417960d74e0fa65db4c P 08967013ba3f462dafe27d4b68f79f5c: Deleting consensus metadata
I20260620 14:56:03.598481 15077 ts_tablet_manager.cc:1918] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 14:56:03.598582 15077 log.cc:1196] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/7e211ac408724417960d74e0fa65db4c
I20260620 14:56:03.598698 14469 catalog_manager.cc:4841] TS 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597): tablet 7e211ac408724417960d74e0fa65db4c (table test-table [id=8bedabba53c646b79e28a908333e7fd1]) successfully deleted
I20260620 14:56:03.598980 15077 ts_tablet_manager.cc:1939] T 7e211ac408724417960d74e0fa65db4c P 2e17af71c2404d6c928fd06838f3d465: Deleting consensus metadata
I20260620 14:56:03.599390 14468 catalog_manager.cc:4841] TS 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697): tablet 7e211ac408724417960d74e0fa65db4c (table test-table [id=8bedabba53c646b79e28a908333e7fd1]) successfully deleted
Jun 20 14:56:03 dist-test-slave-7v06 krb5kdc[14438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967363, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 14:56:03 dist-test-slave-7v06 krb5kdc[14438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967363, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:03.622911 15085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:03.613879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44750 (local address 127.12.116.190:41773)
0620 14:56:03.614050 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:03.614052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:03.614114 (+ 62us) server_negotiation.cc:407] Connection header received
0620 14:56:03.614152 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:03.614153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:03.614164 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:03.614259 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:03.614957 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:03.615551 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:03.616648 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:03.616859 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:03.616916 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:03.619671 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:03.619673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:03.619674 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:03.619682 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:03.621453 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:03.621954 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:03.621955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:03.621955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:03.622025 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:03.622281 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:03.622282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:03.622282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:03.622433 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:03.622543 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:03.622736 (+ 193us) server_negotiation.cc:299] Negotiation successful
0620 14:56:03.622819 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
I20260620 14:56:03.625476 14482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:03.625731 14482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:03.627637 14620 tablet_service.cc:1467] Processing CreateTablet for tablet 06aa24c1f1cd4b40a0483084c09f6d44 (DEFAULT_TABLE table=test-table [id=73824a8938a148f9b3b5df9bb4433f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:03.627637 14760 tablet_service.cc:1467] Processing CreateTablet for tablet 06aa24c1f1cd4b40a0483084c09f6d44 (DEFAULT_TABLE table=test-table [id=73824a8938a148f9b3b5df9bb4433f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:03.627813 14620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06aa24c1f1cd4b40a0483084c09f6d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:03.627813 14760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06aa24c1f1cd4b40a0483084c09f6d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:03.631440 15086 tablet_bootstrap.cc:492] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Bootstrap starting.
I20260620 14:56:03.631561 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 06aa24c1f1cd4b40a0483084c09f6d44 (DEFAULT_TABLE table=test-table [id=73824a8938a148f9b3b5df9bb4433f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:03.631729 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06aa24c1f1cd4b40a0483084c09f6d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:03.631963 15086 tablet_bootstrap.cc:654] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:03.632375 15087 tablet_bootstrap.cc:492] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Bootstrap starting.
I20260620 14:56:03.632798 15086 tablet_bootstrap.cc:492] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: No bootstrap required, opened a new log
I20260620 14:56:03.633001 15086 ts_tablet_manager.cc:1397] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:03.633054 15087 tablet_bootstrap.cc:654] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:03.633230 15086 raft_consensus.cc:348] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.633325 15086 raft_consensus.cc:374] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:03.633347 15086 raft_consensus.cc:729] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08967013ba3f462dafe27d4b68f79f5c, State: Initialized, Role: FOLLOWER
I20260620 14:56:03.633419 15090 tablet_bootstrap.cc:492] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Bootstrap starting.
I20260620 14:56:03.633430 15086 consensus_queue.cc:260] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.634001 15087 tablet_bootstrap.cc:492] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: No bootstrap required, opened a new log
I20260620 14:56:03.634091 15087 ts_tablet_manager.cc:1397] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:03.633910 15086 ts_tablet_manager.cc:1428] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:03.634263 15087 raft_consensus.cc:348] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.634387 15087 raft_consensus.cc:374] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:03.634409 15087 raft_consensus.cc:729] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Initialized, Role: FOLLOWER
I20260620 14:56:03.634634 15087 consensus_queue.cc:260] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.634860 15087 ts_tablet_manager.cc:1428] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:03.635412 15090 tablet_bootstrap.cc:654] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:03.636304 15090 tablet_bootstrap.cc:492] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: No bootstrap required, opened a new log
I20260620 14:56:03.636432 15090 ts_tablet_manager.cc:1397] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260620 14:56:03.636586 15090 raft_consensus.cc:348] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.636655 15090 raft_consensus.cc:374] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:03.636669 15090 raft_consensus.cc:729] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17af71c2404d6c928fd06838f3d465, State: Initialized, Role: FOLLOWER
I20260620 14:56:03.636773 15090 consensus_queue.cc:260] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.636912 15090 ts_tablet_manager.cc:1428] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:03.775862 14997 raft_consensus.cc:482] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:03.776000 14997 raft_consensus.cc:504] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.776204 14997 leader_election.cc:288] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:03.776530 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06aa24c1f1cd4b40a0483084c09f6d44" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465" is_pre_election: true
I20260620 14:56:03.776530 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06aa24c1f1cd4b40a0483084c09f6d44" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c" is_pre_election: true
I20260620 14:56:03.776647 14640 raft_consensus.cc:2454] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:03.776647 14920 raft_consensus.cc:2454] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:03.776878 14713 leader_election.cc:302] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08967013ba3f462dafe27d4b68f79f5c, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:03.776991 14997 raft_consensus.cc:2781] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:03.777045 14997 raft_consensus.cc:482] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:03.777065 14997 raft_consensus.cc:3037] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:03.777860 14997 raft_consensus.cc:504] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.778038 14997 leader_election.cc:288] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Requested vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:03.778256 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06aa24c1f1cd4b40a0483084c09f6d44" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c"
I20260620 14:56:03.778301 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06aa24c1f1cd4b40a0483084c09f6d44" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465"
I20260620 14:56:03.778347 14640 raft_consensus.cc:3037] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:03.778375 14920 raft_consensus.cc:3037] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:03.779202 14920 raft_consensus.cc:2454] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:03.779219 14640 raft_consensus.cc:2454] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:03.779461 14713 leader_election.cc:302] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08967013ba3f462dafe27d4b68f79f5c, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:03.779656 14997 raft_consensus.cc:2781] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:03.779830 14997 raft_consensus.cc:686] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Becoming Leader. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Running, Role: LEADER
I20260620 14:56:03.779922 14997 consensus_queue.cc:237] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.780710 14483 catalog_manager.cc:5495] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6a315c588aad4cccb1241109d31a4b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:03.824481 15095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:03.821075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54034 (local address 127.12.116.130:43301)
0620 14:56:03.821324 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:03.821325 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:03.821333 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:03.821358 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:03.821359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:03.821371 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:03.821439 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:03.821769 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:03.822321 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:03.823363 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:03.823579 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:03.823640 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:03.823885 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:03.823932 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:03.823990 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:03.824248 (+ 258us) server_negotiation.cc:299] Negotiation successful
0620 14:56:03.824276 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":182,"threads_started":1}
I20260620 14:56:03.828454 14920 raft_consensus.cc:1261] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:03.828775 14640 raft_consensus.cc:1261] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:03.828761 14997 consensus_queue.cc:1035] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:03.829478 14997 consensus_queue.cc:1035] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:03.844399 14483 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:03.844535 14483 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:03.845631 14483 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Sending DeleteTablet for 3 replicas of tablet 06aa24c1f1cd4b40a0483084c09f6d44
I20260620 14:56:03.845988 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 06aa24c1f1cd4b40a0483084c09f6d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:03 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:32964
I20260620 14:56:03.845997 14620 tablet_service.cc:1514] Processing DeleteTablet for tablet 06aa24c1f1cd4b40a0483084c09f6d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:03 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:57812
I20260620 14:56:03.846101 15076 tablet_replica.cc:330] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: stopping tablet replica
I20260620 14:56:03.846100 15077 tablet_replica.cc:330] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: stopping tablet replica
I20260620 14:56:03.846159 15076 raft_consensus.cc:2229] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:03.846192 15077 raft_consensus.cc:2229] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:03.846244 15076 raft_consensus.cc:2258] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:03.846251 15077 raft_consensus.cc:2258] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:03.846421 14760 tablet_service.cc:1514] Processing DeleteTablet for tablet 06aa24c1f1cd4b40a0483084c09f6d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:03 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54004
I20260620 14:56:03.846527 15075 tablet_replica.cc:330] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: stopping tablet replica
I20260620 14:56:03.846591 15075 raft_consensus.cc:2229] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:03.846659 15075 raft_consensus.cc:2258] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:03.846648 15077 ts_tablet_manager.cc:1905] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:03.846747 15076 ts_tablet_manager.cc:1905] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:03.846783 14483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:03.846959 14483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:03.848318 14760 tablet_service.cc:1467] Processing CreateTablet for tablet 6e891ce17a224940b836a364ee3724ae (DEFAULT_TABLE table=test-table [id=c5ef72c0888b402db663b068e4f18a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:03.848317 14620 tablet_service.cc:1467] Processing CreateTablet for tablet 6e891ce17a224940b836a364ee3724ae (DEFAULT_TABLE table=test-table [id=c5ef72c0888b402db663b068e4f18a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:03.848480 14760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e891ce17a224940b836a364ee3724ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:03.848551 15077 ts_tablet_manager.cc:1918] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:03.848551 15076 ts_tablet_manager.cc:1918] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:03.848610 15077 log.cc:1196] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/06aa24c1f1cd4b40a0483084c09f6d44
I20260620 14:56:03.848610 15076 log.cc:1196] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/06aa24c1f1cd4b40a0483084c09f6d44
I20260620 14:56:03.848843 15077 ts_tablet_manager.cc:1939] T 06aa24c1f1cd4b40a0483084c09f6d44 P 2e17af71c2404d6c928fd06838f3d465: Deleting consensus metadata
I20260620 14:56:03.848846 15076 ts_tablet_manager.cc:1939] T 06aa24c1f1cd4b40a0483084c09f6d44 P 08967013ba3f462dafe27d4b68f79f5c: Deleting consensus metadata
I20260620 14:56:03.848995 14620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e891ce17a224940b836a364ee3724ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:03.850041 15087 tablet_bootstrap.cc:492] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: Bootstrap starting.
I20260620 14:56:03.850452 15087 tablet_bootstrap.cc:654] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:03.850533 15075 ts_tablet_manager.cc:1905] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:03.851243 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 6e891ce17a224940b836a364ee3724ae (DEFAULT_TABLE table=test-table [id=c5ef72c0888b402db663b068e4f18a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:03.851624 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e891ce17a224940b836a364ee3724ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:03.851902 14468 catalog_manager.cc:4841] TS 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697): tablet 06aa24c1f1cd4b40a0483084c09f6d44 (table test-table [id=73824a8938a148f9b3b5df9bb4433f99]) successfully deleted
I20260620 14:56:03.852682 14469 catalog_manager.cc:4841] TS 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597): tablet 06aa24c1f1cd4b40a0483084c09f6d44 (table test-table [id=73824a8938a148f9b3b5df9bb4433f99]) successfully deleted
I20260620 14:56:03.853318 15086 tablet_bootstrap.cc:492] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c: Bootstrap starting.
I20260620 14:56:03.853772 15087 tablet_bootstrap.cc:492] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: No bootstrap required, opened a new log
I20260620 14:56:03.853820 15087 ts_tablet_manager.cc:1397] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260620 14:56:03.853941 15087 raft_consensus.cc:348] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.853997 15087 raft_consensus.cc:374] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:03.854020 15086 tablet_bootstrap.cc:654] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:03.854063 15087 raft_consensus.cc:729] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Initialized, Role: FOLLOWER
I20260620 14:56:03.854560 15090 tablet_bootstrap.cc:492] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Bootstrap starting.
I20260620 14:56:03.854610 15075 ts_tablet_manager.cc:1918] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:03.854669 15075 log.cc:1196] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/06aa24c1f1cd4b40a0483084c09f6d44
I20260620 14:56:03.854629 15087 consensus_queue.cc:260] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.854772 15087 ts_tablet_manager.cc:1428] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:03.854969 15090 tablet_bootstrap.cc:654] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:03.855744 15075 ts_tablet_manager.cc:1939] T 06aa24c1f1cd4b40a0483084c09f6d44 P 6a315c588aad4cccb1241109d31a4b04: Deleting consensus metadata
I20260620 14:56:03.856722 15086 tablet_bootstrap.cc:492] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c: No bootstrap required, opened a new log
I20260620 14:56:03.856789 15086 ts_tablet_manager.cc:1397] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:56:03.856880 14468 catalog_manager.cc:4841] TS 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130:43301): tablet 06aa24c1f1cd4b40a0483084c09f6d44 (table test-table [id=73824a8938a148f9b3b5df9bb4433f99]) successfully deleted
I20260620 14:56:03.856992 15086 raft_consensus.cc:348] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.857087 15086 raft_consensus.cc:374] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:03.857110 15086 raft_consensus.cc:729] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08967013ba3f462dafe27d4b68f79f5c, State: Initialized, Role: FOLLOWER
I20260620 14:56:03.857151 15086 consensus_queue.cc:260] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.857266 15086 ts_tablet_manager.cc:1428] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:56:03.857390 15090 tablet_bootstrap.cc:492] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: No bootstrap required, opened a new log
I20260620 14:56:03.857482 15090 ts_tablet_manager.cc:1397] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:56:03.857651 15090 raft_consensus.cc:348] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.857756 15090 raft_consensus.cc:374] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:03.857782 15090 raft_consensus.cc:729] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17af71c2404d6c928fd06838f3d465, State: Initialized, Role: FOLLOWER
I20260620 14:56:03.857829 15090 consensus_queue.cc:260] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.857940 15090 ts_tablet_manager.cc:1428] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:56:03.863405 15067 raft_consensus.cc:482] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:03.863528 15067 raft_consensus.cc:504] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.863762 15067 leader_election.cc:288] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:03.863969 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e891ce17a224940b836a364ee3724ae" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c" is_pre_election: true
I20260620 14:56:03.864004 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e891ce17a224940b836a364ee3724ae" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465" is_pre_election: true
I20260620 14:56:03.864099 14920 raft_consensus.cc:2454] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:03.864105 14640 raft_consensus.cc:2454] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 0.
I20260620 14:56:03.864261 14713 leader_election.cc:302] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08967013ba3f462dafe27d4b68f79f5c, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:03.864396 15067 raft_consensus.cc:2781] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:03.864439 15067 raft_consensus.cc:482] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:03.864470 15067 raft_consensus.cc:3037] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:03.865263 15067 raft_consensus.cc:504] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.865438 15067 leader_election.cc:288] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Requested vote from peers 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597), 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697)
I20260620 14:56:03.865597 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e891ce17a224940b836a364ee3724ae" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08967013ba3f462dafe27d4b68f79f5c"
I20260620 14:56:03.865688 14640 raft_consensus.cc:3037] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:03.865672 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e891ce17a224940b836a364ee3724ae" candidate_uuid: "6a315c588aad4cccb1241109d31a4b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e17af71c2404d6c928fd06838f3d465"
I20260620 14:56:03.865749 14920 raft_consensus.cc:3037] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:03.866540 14640 raft_consensus.cc:2454] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:03.866540 14920 raft_consensus.cc:2454] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a315c588aad4cccb1241109d31a4b04 in term 1.
I20260620 14:56:03.866832 14712 leader_election.cc:302] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e17af71c2404d6c928fd06838f3d465, 6a315c588aad4cccb1241109d31a4b04; no voters:
I20260620 14:56:03.866947 15067 raft_consensus.cc:2781] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:03.867010 15067 raft_consensus.cc:686] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Becoming Leader. State: Replica: 6a315c588aad4cccb1241109d31a4b04, State: Running, Role: LEADER
I20260620 14:56:03.867062 15067 consensus_queue.cc:237] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } }
I20260620 14:56:03.867938 14482 catalog_manager.cc:5495] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a315c588aad4cccb1241109d31a4b04 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6a315c588aad4cccb1241109d31a4b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a315c588aad4cccb1241109d31a4b04" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:03.877344 14920 raft_consensus.cc:1261] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:03.877360 14640 raft_consensus.cc:1261] T 6e891ce17a224940b836a364ee3724ae P 08967013ba3f462dafe27d4b68f79f5c [term 1 FOLLOWER]: Refusing update from remote peer 6a315c588aad4cccb1241109d31a4b04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:03.877588 15067 consensus_queue.cc:1035] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e17af71c2404d6c928fd06838f3d465" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:03.877696 14997 consensus_queue.cc:1035] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08967013ba3f462dafe27d4b68f79f5c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:56:03.883785 15059 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260620 14:56:05.419777 14482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:05.419894 14482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:05.420921 14482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 630d4791929b48a4a213ecf1e4ba264c: Sending DeleteTablet for 3 replicas of tablet 6e891ce17a224940b836a364ee3724ae
I20260620 14:56:05.421319 14760 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e891ce17a224940b836a364ee3724ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:05 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54004
I20260620 14:56:05.421334 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e891ce17a224940b836a364ee3724ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:05 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:32964
I20260620 14:56:05.421550 15128 tablet_replica.cc:330] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: stopping tablet replica
I20260620 14:56:05.421536 14620 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e891ce17a224940b836a364ee3724ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:05 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:57812
I20260620 14:56:05.421684 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 14555
I20260620 14:56:05.423249 15129 tablet_replica.cc:330] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: stopping tablet replica
I20260620 14:56:05.423347 15129 raft_consensus.cc:2229] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:05.423399 15129 raft_consensus.cc:2258] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:05.423503 15128 raft_consensus.cc:2229] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:05.423604 15128 raft_consensus.cc:2258] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:05.423885 15128 ts_tablet_manager.cc:1905] T 6e891ce17a224940b836a364ee3724ae P 6a315c588aad4cccb1241109d31a4b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:05.425726 15129 ts_tablet_manager.cc:1905] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 14:56:05.428896 14469 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:36597 (error 108)
I20260620 14:56:05.429067 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 14695
I20260620 14:56:05.430339 15132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:05.429961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:36597 (local address 127.0.0.1:57828)
0620 14:56:05.430216 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:05.430282 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":65,"threads_started":1}
W20260620 14:56:05.430495 14469 catalog_manager.cc:4584] TS 08967013ba3f462dafe27d4b68f79f5c (127.12.116.129:36597): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6e891ce17a224940b836a364ee3724ae: Network error: Client connection negotiation failed: client connection to 127.12.116.129:36597: connect: Connection refused (error 111)
I20260620 14:56:05.460594 15129 ts_tablet_manager.cc:1918] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 14:56:05.460736 15129 log.cc:1196] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/6e891ce17a224940b836a364ee3724ae
I20260620 14:56:05.461309 15129 ts_tablet_manager.cc:1939] T 6e891ce17a224940b836a364ee3724ae P 2e17af71c2404d6c928fd06838f3d465: Deleting consensus metadata
I20260620 14:56:05.461861 14468 catalog_manager.cc:4841] TS 2e17af71c2404d6c928fd06838f3d465 (127.12.116.131:40697): tablet 6e891ce17a224940b836a364ee3724ae (table test-table [id=c5ef72c0888b402db663b068e4f18a09]) successfully deleted
I20260620 14:56:05.465544 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 14835
I20260620 14:56:05.465673 15132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:05.465504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43301 (local address 127.0.0.1:54038)
0620 14:56:05.465585 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:05.465624 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.130:43301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260620 14:56:05.474851 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 14451
2026-06-20T14:56:05Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6550 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:07 dist-test-slave-7v06 krb5kdc[15135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:07 dist-test-slave-7v06 krb5kdc[15135](info): set up 2 sockets
Jun 20 14:56:07 dist-test-slave-7v06 krb5kdc[15135](info): commencing operation
krb5kdc: starting...
W20260620 14:56:08.449167 12754 mini_kdc.cc:121] Time spent starting KDC: real 2.950s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:08 dist-test-slave-7v06 krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:08.617439 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37211
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:08.713192 15148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:08.714447 15148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:08.714566 15148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:08.716657 15148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:08.716753 15148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:08.716780 15148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:08.716804 15148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:08.716836 15148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:08.719193 15148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:08.719764 15148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:08.720124 15148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:08.727239 15154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:08.727535 15156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:08.727308 15148 server_base.cc:1034] running on GCE node
W20260620 14:56:08.727412 15153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:08.728065 15148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:08.728498 15148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:08.729709 15148 hybrid_clock.cc:648] HybridClock initialized: now 1781967368729687 us; error 44 us; skew 500 ppm
Jun 20 14:56:08 dist-test-slave-7v06 krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:08.738866 15148 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:08.739449 15148 webserver.cc:460] Webserver started at http://127.12.116.190:38537/ using document root <none> and password file <none>
I20260620 14:56:08.739738 15148 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:08.739814 15148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:08.739981 15148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:08.741274 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "5f07045afb7c4b409f4a7e9fea089e46"
format_stamp: "Formatted at 2026-06-20 14:56:08 on dist-test-slave-7v06"
server_key: "dd3a69089715779449e3a70f12e21354"
server_key_iv: "6eda01a1602bcb29748ea3a554b7aae5"
server_key_version: "encryptionkey@0"
I20260620 14:56:08.741667 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "5f07045afb7c4b409f4a7e9fea089e46"
format_stamp: "Formatted at 2026-06-20 14:56:08 on dist-test-slave-7v06"
server_key: "dd3a69089715779449e3a70f12e21354"
server_key_iv: "6eda01a1602bcb29748ea3a554b7aae5"
server_key_version: "encryptionkey@0"
I20260620 14:56:08.743224 15148 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:56:08.744074 15163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:08.744385 15148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:08.744504 15148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "5f07045afb7c4b409f4a7e9fea089e46"
format_stamp: "Formatted at 2026-06-20 14:56:08 on dist-test-slave-7v06"
server_key: "dd3a69089715779449e3a70f12e21354"
server_key_iv: "6eda01a1602bcb29748ea3a554b7aae5"
server_key_version: "encryptionkey@0"
I20260620 14:56:08.744587 15148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:08.777100 15148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:08.779752 15148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:08.779943 15148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:08.785463 15148 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:37211
I20260620 14:56:08.785549 15215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:37211 every 8 connection(s)
I20260620 14:56:08.785996 15148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:08.787048 15216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:08.790439 15216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46: Bootstrap starting.
I20260620 14:56:08.791349 15216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:08.791728 15216 log.cc:824] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:08.792671 15216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46: No bootstrap required, opened a new log
I20260620 14:56:08.794759 15216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f07045afb7c4b409f4a7e9fea089e46" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37211 } }
I20260620 14:56:08.794970 15216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:08.794993 15216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f07045afb7c4b409f4a7e9fea089e46, State: Initialized, Role: FOLLOWER
I20260620 14:56:08.795125 15216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f07045afb7c4b409f4a7e9fea089e46" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37211 } }
I20260620 14:56:08.795205 15216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:08.795257 15216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:08.795300 15216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:08.795733 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15148
I20260620 14:56:08.795967 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:08.796012 15216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f07045afb7c4b409f4a7e9fea089e46" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37211 } }
I20260620 14:56:08.796198 12754 external_mini_cluster.cc:1428] Setting key f7104322bd3f5dbe63c98d2538c8397e
I20260620 14:56:08.796139 15216 leader_election.cc:302] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f07045afb7c4b409f4a7e9fea089e46; no voters:
I20260620 14:56:08.796904 15216 leader_election.cc:288] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:08.796931 15219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:08.797155 15219 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [term 1 LEADER]: Becoming Leader. State: Replica: 5f07045afb7c4b409f4a7e9fea089e46, State: Running, Role: LEADER
I20260620 14:56:08.797242 15216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:08.797338 15219 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f07045afb7c4b409f4a7e9fea089e46" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37211 } }
I20260620 14:56:08.797854 15219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f07045afb7c4b409f4a7e9fea089e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f07045afb7c4b409f4a7e9fea089e46" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37211 } } }
I20260620 14:56:08.798025 15219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:08.798229 15219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f07045afb7c4b409f4a7e9fea089e46. Latest consensus state: current_term: 1 leader_uuid: "5f07045afb7c4b409f4a7e9fea089e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f07045afb7c4b409f4a7e9fea089e46" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37211 } } }
I20260620 14:56:08.798367 15219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:08.798389 15226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:08.799876 15226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:08.801956 15226 catalog_manager.cc:1347] Generated new cluster ID: 59d28d96450e4eab8694e56a124ad428
I20260620 14:56:08.802043 15226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:56:08 dist-test-slave-7v06 krb5kdc[15135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:08.811595 15224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:08.797892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42272 (local address 127.12.116.190:37211)
0620 14:56:08.798296 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:08.798311 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:08.798360 (+ 49us) server_negotiation.cc:407] Connection header received
0620 14:56:08.798579 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:08.798590 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:08.798671 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:08.800744 (+ 2073us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:08.800883 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:08.802089 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:08.803271 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:08.803947 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:08.804459 (+ 512us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:08.807094 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:08.807100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:08.807101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:08.807116 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:08.809339 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:08.809778 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:08.809781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:08.809782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:08.809898 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:08.810070 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:08.810071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:08.810072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:08.810401 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:08.810551 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:08.811134 (+ 583us) server_negotiation.cc:299] Negotiation successful
0620 14:56:08.811303 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":182,"threads_started":1}
I20260620 14:56:08.847586 15226 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:08.848451 15226 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:08.852596 15226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f07045afb7c4b409f4a7e9fea089e46: Generated new TSK 0
I20260620 14:56:08.852900 15226 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:08.912659 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37211
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:09.033851 15242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:09.034152 15242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:09.034185 15242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:09.039176 15242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:09.039294 15242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:09.039332 15242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:09.041566 15242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:09.041901 15242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:09.042223 15242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:09.048911 15250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:09.048974 15247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:09.049990 15248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:09.050352 15242 server_base.cc:1034] running on GCE node
I20260620 14:56:09.050750 15242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:09.051088 15242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:09.052410 15242 hybrid_clock.cc:648] HybridClock initialized: now 1781967369052261 us; error 86 us; skew 500 ppm
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967369, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:09.057102 15242 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:09.057693 15242 webserver.cc:460] Webserver started at http://127.12.116.129:45253/ using document root <none> and password file <none>
I20260620 14:56:09.057971 15242 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:09.058054 15242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:09.058238 15242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:09.059463 15242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "53fa3ba1f463429888fdb7a24d496f83"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "964fe6d9b924fbe1c3435af698dc1083"
server_key_iv: "010028a6d7263eb046f0b4705e3081ac"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.059924 15242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "53fa3ba1f463429888fdb7a24d496f83"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "964fe6d9b924fbe1c3435af698dc1083"
server_key_iv: "010028a6d7263eb046f0b4705e3081ac"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.061779 15242 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 14:56:09.062965 15257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.063333 15242 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260620 14:56:09.063463 15242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "53fa3ba1f463429888fdb7a24d496f83"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "964fe6d9b924fbe1c3435af698dc1083"
server_key_iv: "010028a6d7263eb046f0b4705e3081ac"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.063565 15242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:09.088019 15242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:09.091290 15242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:09.092101 15242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:09.092775 15242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:09.093314 15242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:09.093390 15242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.093432 15242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:09.093461 15242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.101961 15242 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:45119
I20260620 14:56:09.102064 15370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:45119 every 8 connection(s)
I20260620 14:56:09.102432 15242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:09.105926 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15242
I20260620 14:56:09.106159 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:09.106410 12754 external_mini_cluster.cc:1428] Setting key bc65ccf3930ed1cbe96970dcb2f63aa9
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967369, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:56:09.116765 15224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:09.103616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:47337 (local address 127.12.116.190:37211)
0620 14:56:09.103676 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:09.103679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:09.104210 (+ 531us) server_negotiation.cc:407] Connection header received
0620 14:56:09.104699 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:09.104702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:09.104730 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:09.104845 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:09.106962 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.107681 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.109308 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.109566 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.109679 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:09.113158 (+ 3479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:09.113160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:09.113160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:09.113171 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:09.114850 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:09.115406 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:09.115407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:09.115408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:09.115472 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:09.115765 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:09.115766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:09.115766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:09.115900 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:09.115980 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:09.116395 (+ 415us) server_negotiation.cc:299] Negotiation successful
0620 14:56:09.116509 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 14:56:09.117136 15373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:09.103420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37211 (local address 127.12.116.129:47337)
0620 14:56:09.103831 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:09.103879 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:09.104490 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:09.105142 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:09.105148 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:09.106528 (+ 1380us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:09.106867 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:09.106877 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.107826 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.107828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:09.109109 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:09.109115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.109691 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.109693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:09.109876 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:09.110623 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:09.110635 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:09.112954 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:09.114983 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:09.114996 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:09.114999 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:09.115310 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:09.115546 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:09.115546 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:09.115547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:09.115687 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:09.115971 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:09.115978 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:09.116193 (+ 215us) client_negotiation.cc:769] Sending connection context
0620 14:56:09.116325 (+ 132us) client_negotiation.cc:240] Negotiation successful
0620 14:56:09.116550 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":114,"threads_started":1}
I20260620 14:56:09.117915 15371 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37211
I20260620 14:56:09.118065 15371 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:09.118276 15371 heartbeater.cc:511] Master 127.12.116.190:37211 requested a full tablet report, sending...
I20260620 14:56:09.119333 15180 ts_manager.cc:194] Registered new tserver with Master: 53fa3ba1f463429888fdb7a24d496f83 (127.12.116.129:45119)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
I20260620 14:56:09.120103 15180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:47337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:09.142603 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37211
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:09.252249 15376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:09.252748 15376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:09.252787 15376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:09.254774 15376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:09.254842 15376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:09.254876 15376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:09.257076 15376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:09.257408 15376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:09.258270 15376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:09.264470 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:09.264456 15384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:09.264760 15376 server_base.cc:1034] running on GCE node
W20260620 14:56:09.264699 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:09.265041 15376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:09.265318 15376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:09.266562 15376 hybrid_clock.cc:648] HybridClock initialized: now 1781967369266513 us; error 67 us; skew 500 ppm
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967369, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:09.269910 15376 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:09.270514 15376 webserver.cc:460] Webserver started at http://127.12.116.130:40051/ using document root <none> and password file <none>
I20260620 14:56:09.270785 15376 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:09.270864 15376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:09.271023 15376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:09.272209 15376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "eef21f46901f4b95919ffa4f8a41fdc6"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "9a7b63cfdd4238dfa4044e20f6a8f41f"
server_key_iv: "224bd43183087bdb26791593325e1372"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.272711 15376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "eef21f46901f4b95919ffa4f8a41fdc6"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "9a7b63cfdd4238dfa4044e20f6a8f41f"
server_key_iv: "224bd43183087bdb26791593325e1372"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.274569 15376 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:09.276485 15391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.276981 15376 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:56:09.277218 15376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "eef21f46901f4b95919ffa4f8a41fdc6"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "9a7b63cfdd4238dfa4044e20f6a8f41f"
server_key_iv: "224bd43183087bdb26791593325e1372"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.277312 15376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:09.299893 15376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:09.302943 15376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:09.303083 15376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:09.303308 15376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:09.303591 15376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:09.303632 15376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.303656 15376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:09.303668 15376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.310075 15376 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:34933
I20260620 14:56:09.310189 15504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:34933 every 8 connection(s)
I20260620 14:56:09.310525 15376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967369, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:09.319813 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15376
I20260620 14:56:09.319911 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:09.320148 12754 external_mini_cluster.cc:1428] Setting key b05149e5f76812f58e2e640adc82de35
I20260620 14:56:09.325601 15224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:09.311520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:41309 (local address 127.12.116.190:37211)
0620 14:56:09.311597 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:09.311600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:09.311795 (+ 195us) server_negotiation.cc:407] Connection header received
0620 14:56:09.312433 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:09.312435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:09.312456 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:09.312520 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:09.313597 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.314362 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.315898 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.316430 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.316548 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:09.320623 (+ 4075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:09.320629 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:09.320629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:09.320648 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:09.322903 (+ 2255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:09.323842 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:09.323844 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:09.323844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:09.323917 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:09.324433 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:09.324434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:09.324434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:09.324636 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:09.324717 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:09.325276 (+ 559us) server_negotiation.cc:299] Negotiation successful
0620 14:56:09.325485 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 14:56:09.325896 15507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:09.311458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37211 (local address 127.12.116.130:41309)
0620 14:56:09.311650 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:09.311695 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:09.312246 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:09.312606 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:09.312610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:09.313249 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:09.313476 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:09.313482 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.314561 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.314564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:09.315695 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:09.315701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.316714 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.316716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:09.316906 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:09.317916 (+ 1010us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:09.317927 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:09.320494 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:09.323148 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:09.323165 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:09.323170 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:09.323683 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:09.324014 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:09.324015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:09.324016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:09.324242 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:09.324735 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:09.324742 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:09.324965 (+ 223us) client_negotiation.cc:769] Sending connection context
0620 14:56:09.325112 (+ 147us) client_negotiation.cc:240] Negotiation successful
0620 14:56:09.325507 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
I20260620 14:56:09.326671 15505 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37211
I20260620 14:56:09.326809 15505 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:09.327085 15505 heartbeater.cc:511] Master 127.12.116.190:37211 requested a full tablet report, sending...
I20260620 14:56:09.327719 15180 ts_manager.cc:194] Registered new tserver with Master: eef21f46901f4b95919ffa4f8a41fdc6 (127.12.116.130:34933)
I20260620 14:56:09.328186 15180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:41309
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:09.372560 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37211
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:09.480785 15510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:09.481122 15510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:09.481163 15510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:09.483114 15510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:09.483196 15510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:09.483237 15510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:09.485718 15510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:09.486025 15510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:09.486240 15510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:56:09.492403 15510 server_base.cc:1034] running on GCE node
W20260620 14:56:09.492259 15518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:09.492290 15515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:09.492265 15516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:09.492906 15510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:09.493220 15510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:09.494462 15510 hybrid_clock.cc:648] HybridClock initialized: now 1781967369494411 us; error 66 us; skew 500 ppm
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967369, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:09.497938 15510 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:09.498536 15510 webserver.cc:460] Webserver started at http://127.12.116.131:41179/ using document root <none> and password file <none>
I20260620 14:56:09.498956 15510 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:09.499033 15510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:09.499207 15510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:09.501781 15510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "049dfe8874c94f2eb6c5f92f71d626ce"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "614ee8a4981c965b2e7ea49861ffd873"
server_key_iv: "b8fbd6ebb41da01312b23776ff8b9077"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.502514 15510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "049dfe8874c94f2eb6c5f92f71d626ce"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "614ee8a4981c965b2e7ea49861ffd873"
server_key_iv: "b8fbd6ebb41da01312b23776ff8b9077"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.504210 15510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:09.505329 15525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.505924 15510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:09.506173 15510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "049dfe8874c94f2eb6c5f92f71d626ce"
format_stamp: "Formatted at 2026-06-20 14:56:09 on dist-test-slave-7v06"
server_key: "614ee8a4981c965b2e7ea49861ffd873"
server_key_iv: "b8fbd6ebb41da01312b23776ff8b9077"
server_key_version: "encryptionkey@0"
I20260620 14:56:09.506313 15510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:09.530738 15510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:09.536019 15510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:09.536828 15510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:09.537241 15510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:09.538923 15510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:09.539012 15510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.539065 15510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:09.539096 15510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:09.546384 15510 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:43325
I20260620 14:56:09.546656 15638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:43325 every 8 connection(s)
I20260620 14:56:09.546979 15510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:09.551836 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15510
I20260620 14:56:09.551990 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:09.552210 12754 external_mini_cluster.cc:1428] Setting key 4b64c28eb236bc7104548eb24bd5f259
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967369, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:09.562866 15224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:09.548116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:53417 (local address 127.12.116.190:37211)
0620 14:56:09.548270 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:09.548272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:09.548501 (+ 229us) server_negotiation.cc:407] Connection header received
0620 14:56:09.549157 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:09.549159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:09.549173 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:09.549221 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:09.550515 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.551034 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.552454 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.552927 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.553276 (+ 349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:09.558251 (+ 4975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:09.558253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:09.558253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:09.558265 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:09.560766 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:09.561523 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:09.561524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:09.561525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:09.561597 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:09.562034 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:09.562035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:09.562035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:09.562181 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:09.562241 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:09.562698 (+ 457us) server_negotiation.cc:299] Negotiation successful
0620 14:56:09.562787 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260620 14:56:09.563166 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:09.548030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37211 (local address 127.12.116.131:53417)
0620 14:56:09.548306 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:09.548385 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:09.549028 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:09.549323 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:09.549332 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:09.550149 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:09.550372 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:09.550377 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.551155 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.551156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:09.552282 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:09.552286 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:09.553311 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:09.553312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:09.553756 (+ 444us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:09.555226 (+ 1470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:09.555240 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:09.558068 (+ 2828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:09.560916 (+ 2848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:09.560931 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:09.560934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:09.561399 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:09.561778 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:09.561779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:09.561779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:09.561927 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:09.562271 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:09.562277 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:09.562464 (+ 187us) client_negotiation.cc:769] Sending connection context
0620 14:56:09.562570 (+ 106us) client_negotiation.cc:240] Negotiation successful
0620 14:56:09.562856 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":100,"threads_started":1}
I20260620 14:56:09.563874 15639 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37211
I20260620 14:56:09.563987 15639 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:09.564229 15639 heartbeater.cc:511] Master 127.12.116.190:37211 requested a full tablet report, sending...
I20260620 14:56:09.564800 15180 ts_manager.cc:194] Registered new tserver with Master: 049dfe8874c94f2eb6c5f92f71d626ce (127.12.116.131:43325)
I20260620 14:56:09.565486 15180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:53417
I20260620 14:56:09.565950 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260620 14:56:09.583760 15224 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:09.582411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42274 (local address 127.12.116.190:37211)
0620 14:56:09.582482 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:09.582484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:09.582617 (+ 133us) server_negotiation.cc:407] Connection header received
0620 14:56:09.582697 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:09.582698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:09.582710 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:09.582782 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:09.583500 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42274: BlockingRecv error: recv got EOF from 127.0.0.1:42274 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 14:56:09.584851 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15242
I20260620 14:56:09.589813 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15376
I20260620 14:56:09.594895 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15510
I20260620 14:56:09.601543 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15148
2026-06-20T14:56:09Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4123 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15651](info): set up 2 sockets
Jun 20 14:56:09 dist-test-slave-7v06 krb5kdc[15651](info): commencing operation
krb5kdc: starting...
W20260620 14:56:10.740760 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:10 dist-test-slave-7v06 krb5kdc[15651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:10.892087 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36635
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:40563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:10.989216 15664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:10.989616 15664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:10.989671 15664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:10.991360 15664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:10.991483 15664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:10.991514 15664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:10.991535 15664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:10.991576 15664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:10.993530 15664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:40563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:10.993896 15664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:10.994194 15664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:11.000774 15672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:11.000808 15669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:11.000706 15670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:11.001129 15664 server_base.cc:1034] running on GCE node
I20260620 14:56:11.001606 15664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:11.002002 15664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:11.003247 15664 hybrid_clock.cc:648] HybridClock initialized: now 1781967371003161 us; error 107 us; skew 500 ppm
Jun 20 14:56:11 dist-test-slave-7v06 krb5kdc[15651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967371, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:11.007046 15664 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:11.007750 15664 webserver.cc:460] Webserver started at http://127.12.116.190:33171/ using document root <none> and password file <none>
I20260620 14:56:11.008064 15664 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:11.008147 15664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:11.008387 15664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:11.009658 15664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "78507e5cd8d24af1ad02e978a552024f"
format_stamp: "Formatted at 2026-06-20 14:56:11 on dist-test-slave-7v06"
server_key: "e0df129e99cc6402a71998055d4477ce"
server_key_iv: "43f380313662d03ffe054a8942496d5a"
server_key_version: "encryptionkey@0"
I20260620 14:56:11.010107 15664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "78507e5cd8d24af1ad02e978a552024f"
format_stamp: "Formatted at 2026-06-20 14:56:11 on dist-test-slave-7v06"
server_key: "e0df129e99cc6402a71998055d4477ce"
server_key_iv: "43f380313662d03ffe054a8942496d5a"
server_key_version: "encryptionkey@0"
I20260620 14:56:11.012619 15664 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 14:56:11.014103 15679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:11.014637 15664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:11.015139 15664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "78507e5cd8d24af1ad02e978a552024f"
format_stamp: "Formatted at 2026-06-20 14:56:11 on dist-test-slave-7v06"
server_key: "e0df129e99cc6402a71998055d4477ce"
server_key_iv: "43f380313662d03ffe054a8942496d5a"
server_key_version: "encryptionkey@0"
I20260620 14:56:11.015271 15664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:11.040006 15664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:11.042809 15664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:11.043007 15664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:11.047650 15664 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:36635
I20260620 14:56:11.047691 15731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:36635 every 8 connection(s)
I20260620 14:56:11.048285 15664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:11.049124 15732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:11.050900 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15664
I20260620 14:56:11.051153 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:11.051370 12754 external_mini_cluster.cc:1428] Setting key caf538b4b3e64e288d33b22f776e5de4
I20260620 14:56:11.052753 15732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f: Bootstrap starting.
I20260620 14:56:11.053622 15732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:11.053989 15732 log.cc:824] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:11.054765 15732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f: No bootstrap required, opened a new log
I20260620 14:56:11.057548 15732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78507e5cd8d24af1ad02e978a552024f" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36635 } }
I20260620 14:56:11.057772 15732 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:11.057814 15732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78507e5cd8d24af1ad02e978a552024f, State: Initialized, Role: FOLLOWER
I20260620 14:56:11.057957 15732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78507e5cd8d24af1ad02e978a552024f" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36635 } }
I20260620 14:56:11.058046 15732 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:11.058084 15732 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:11.058138 15732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:11.059078 15732 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78507e5cd8d24af1ad02e978a552024f" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36635 } }
I20260620 14:56:11.059213 15732 leader_election.cc:302] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78507e5cd8d24af1ad02e978a552024f; no voters:
I20260620 14:56:11.059465 15732 leader_election.cc:288] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:11.059494 15737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:11.059623 15737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [term 1 LEADER]: Becoming Leader. State: Replica: 78507e5cd8d24af1ad02e978a552024f, State: Running, Role: LEADER
Jun 20 14:56:11 dist-test-slave-7v06 krb5kdc[15651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:11.059720 15737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78507e5cd8d24af1ad02e978a552024f" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36635 } }
I20260620 14:56:11.059774 15732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:11.060071 15737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78507e5cd8d24af1ad02e978a552024f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78507e5cd8d24af1ad02e978a552024f" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36635 } } }
I20260620 14:56:11.060235 15737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:11.060470 15737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78507e5cd8d24af1ad02e978a552024f. Latest consensus state: current_term: 1 leader_uuid: "78507e5cd8d24af1ad02e978a552024f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78507e5cd8d24af1ad02e978a552024f" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36635 } } }
I20260620 14:56:11.060617 15737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:11.060976 15743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:11.061574 15743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:11.063526 15743 catalog_manager.cc:1347] Generated new cluster ID: 533bfff086ca4837a2bd1d6d1e90eea0
I20260620 14:56:11.063591 15743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:11.064579 15735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:11.052021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53044 (local address 127.12.116.190:36635)
0620 14:56:11.052236 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:11.052247 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:11.052283 (+ 36us) server_negotiation.cc:407] Connection header received
0620 14:56:11.052797 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:11.052826 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:11.052908 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:11.053050 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:11.053954 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:11.055052 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:11.056191 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:11.056743 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:11.056843 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:11.060283 (+ 3440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:11.060288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:11.060289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:11.060302 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:11.062524 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:11.063114 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:11.063118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:11.063118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:11.063234 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:11.063491 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:11.063492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:11.063493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:11.063864 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:11.063998 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:11.064192 (+ 194us) server_negotiation.cc:299] Negotiation successful
0620 14:56:11.064368 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":130,"threads_started":1}
I20260620 14:56:11.065649 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:56:11.086071 15743 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:11.087219 15743 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:11.094255 15743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78507e5cd8d24af1ad02e978a552024f: Generated new TSK 0
I20260620 14:56:11.094472 15735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:11.090340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53058 (local address 127.12.116.190:36635)
0620 14:56:11.090399 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:11.090401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:11.090540 (+ 139us) server_negotiation.cc:407] Connection header received
0620 14:56:11.090617 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:11.090618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:11.090629 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:11.090690 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:11.091170 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:11.091710 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:11.092736 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:11.092965 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:11.093057 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:11.093867 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:11.093869 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:11.093869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:11.094112 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:11.094132 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:11.094140 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:11.094177 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:11.094322 (+ 145us) server_negotiation.cc:299] Negotiation successful
0620 14:56:11.094353 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":34}
I20260620 14:56:11.094781 15743 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:11.102180 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15664
2026-06-20T14:56:11Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1498 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:11 dist-test-slave-7v06 krb5kdc[15765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:11 dist-test-slave-7v06 krb5kdc[15765](info): set up 2 sockets
Jun 20 14:56:11 dist-test-slave-7v06 krb5kdc[15765](info): commencing operation
krb5kdc: starting...
W20260620 14:56:12.205374 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:12.361256 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36145
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:12.470794 15778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:12.471340 15778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:12.471463 15778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:12.473690 15778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:12.473830 15778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:12.473861 15778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:12.473884 15778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:12.473913 15778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:12.476154 15778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:12.476567 15778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:12.477056 15778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:12.483969 15786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:12.484059 15784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:12.484364 15783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:12.484531 15778 server_base.cc:1034] running on GCE node
I20260620 14:56:12.484838 15778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:12.485268 15778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:12.486469 15778 hybrid_clock.cc:648] HybridClock initialized: now 1781967372486456 us; error 36 us; skew 500 ppm
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:12.490368 15778 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:12.491178 15778 webserver.cc:460] Webserver started at http://127.12.116.190:42805/ using document root <none> and password file <none>
I20260620 14:56:12.491495 15778 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:12.491557 15778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:12.491715 15778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:12.493065 15778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "eb24550a495d45fbba7782844ea7131c"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "3acdd8ff9f216f312cc4e436dd313b68"
server_key_iv: "309e92536cbb791800d4a14ff68ea1e0"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.493503 15778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "eb24550a495d45fbba7782844ea7131c"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "3acdd8ff9f216f312cc4e436dd313b68"
server_key_iv: "309e92536cbb791800d4a14ff68ea1e0"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.495622 15778 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:12.496932 15793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.497362 15778 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:12.497537 15778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "eb24550a495d45fbba7782844ea7131c"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "3acdd8ff9f216f312cc4e436dd313b68"
server_key_iv: "309e92536cbb791800d4a14ff68ea1e0"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.497653 15778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:12.522855 15778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:12.526510 15778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:12.526762 15778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:12.532596 15778 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:36145
I20260620 14:56:12.532701 15845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:36145 every 8 connection(s)
I20260620 14:56:12.533134 15778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:12.534528 15846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:12.538187 15846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c: Bootstrap starting.
I20260620 14:56:12.538797 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15778
I20260620 14:56:12.538900 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:12.539114 12754 external_mini_cluster.cc:1428] Setting key 10e7f2d5b50b451b06eece1cf71b1142
I20260620 14:56:12.539192 15846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:12.539649 15846 log.cc:824] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:12.541072 15846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c: No bootstrap required, opened a new log
I20260620 14:56:12.544358 15846 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb24550a495d45fbba7782844ea7131c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36145 } }
I20260620 14:56:12.544611 15846 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:12.544643 15846 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb24550a495d45fbba7782844ea7131c, State: Initialized, Role: FOLLOWER
I20260620 14:56:12.544836 15846 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb24550a495d45fbba7782844ea7131c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36145 } }
I20260620 14:56:12.544943 15846 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:12.544989 15846 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:12.545047 15846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:12.545856 15846 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb24550a495d45fbba7782844ea7131c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36145 } }
I20260620 14:56:12.545990 15846 leader_election.cc:302] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb24550a495d45fbba7782844ea7131c; no voters:
I20260620 14:56:12.546203 15846 leader_election.cc:288] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:12.546307 15851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:12.546582 15846 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:12.546679 15851 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [term 1 LEADER]: Becoming Leader. State: Replica: eb24550a495d45fbba7782844ea7131c, State: Running, Role: LEADER
I20260620 14:56:12.546975 15851 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb24550a495d45fbba7782844ea7131c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36145 } }
I20260620 14:56:12.547778 15852 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb24550a495d45fbba7782844ea7131c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb24550a495d45fbba7782844ea7131c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36145 } } }
I20260620 14:56:12.547888 15852 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:12.548175 15853 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb24550a495d45fbba7782844ea7131c. Latest consensus state: current_term: 1 leader_uuid: "eb24550a495d45fbba7782844ea7131c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb24550a495d45fbba7782844ea7131c" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36145 } } }
I20260620 14:56:12.548250 15853 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:12.548817 15860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:12.549492 15860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:12.551815 15860 catalog_manager.cc:1347] Generated new cluster ID: 08e9c2ce7140403eb52e833d19ec9294
I20260620 14:56:12.551893 15860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:12.554774 15849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:12.539865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57178 (local address 127.12.116.190:36145)
0620 14:56:12.540187 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:12.540199 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:12.540237 (+ 38us) server_negotiation.cc:407] Connection header received
0620 14:56:12.541318 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:12.541331 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:12.541421 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:12.541826 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:12.542504 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.544229 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.545843 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.546605 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.547203 (+ 598us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:12.550353 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:12.550359 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:12.550359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:12.550374 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:12.552825 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:12.553303 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:12.553307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:12.553308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:12.553436 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:12.553648 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:12.553649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:12.553650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:12.554009 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:12.554196 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:12.554334 (+ 138us) server_negotiation.cc:299] Negotiation successful
0620 14:56:12.554507 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":146,"threads_started":1}
I20260620 14:56:12.574985 15860 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:12.575675 15860 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:12.582379 15860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb24550a495d45fbba7782844ea7131c: Generated new TSK 0
I20260620 14:56:12.582681 15860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:12.616741 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36145
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:12.720775 15872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:12.721041 15872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:12.721071 15872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:12.722506 15872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:12.722559 15872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:12.722592 15872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:12.724252 15872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:12.724529 15872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:12.724758 15872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:56:12.730974 15872 server_base.cc:1034] running on GCE node
W20260620 14:56:12.730947 15878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:12.730894 15880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:12.730894 15877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:12.731611 15872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:12.731891 15872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:12.733054 15872 hybrid_clock.cc:648] HybridClock initialized: now 1781967372732913 us; error 188 us; skew 500 ppm
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:12.736225 15872 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:12.736840 15872 webserver.cc:460] Webserver started at http://127.12.116.129:37055/ using document root <none> and password file <none>
I20260620 14:56:12.737061 15872 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:12.737107 15872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:12.737212 15872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:12.738564 15872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "b2029dd6cd38458abb0c2e1f489b9407"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "99a76accb7be520d7fc6896b8051622c"
server_key_iv: "ef67b0ee7e06e615141fca31496639ff"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.738917 15872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "b2029dd6cd38458abb0c2e1f489b9407"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "99a76accb7be520d7fc6896b8051622c"
server_key_iv: "ef67b0ee7e06e615141fca31496639ff"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.740729 15872 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260620 14:56:12.741677 15887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.741919 15872 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:12.742039 15872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "b2029dd6cd38458abb0c2e1f489b9407"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "99a76accb7be520d7fc6896b8051622c"
server_key_iv: "ef67b0ee7e06e615141fca31496639ff"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.742129 15872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:12.751886 15872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:12.755043 15872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:12.755277 15872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:12.755548 15872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:12.755915 15872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:12.755971 15872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.756008 15872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:12.756052 15872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.766029 15872 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:45773
I20260620 14:56:12.766206 16000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:45773 every 8 connection(s)
I20260620 14:56:12.766775 15872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:12.773900 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 15872
I20260620 14:56:12.774034 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:12.774341 12754 external_mini_cluster.cc:1428] Setting key b38d40e69d94782755eca341aa7b4806
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:12.781524 15849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:12.767958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:33959 (local address 127.12.116.190:36145)
0620 14:56:12.768046 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:12.768049 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:12.768476 (+ 427us) server_negotiation.cc:407] Connection header received
0620 14:56:12.769353 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:12.769354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:12.769370 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:12.769450 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:12.770828 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.771431 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.772837 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.773070 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.773141 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:12.776423 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:12.776424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:12.776425 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:12.776441 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:12.778123 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:12.779591 (+ 1468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:12.779593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:12.779593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:12.779748 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:12.780306 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:12.780308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:12.780308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:12.780733 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:12.780828 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:12.781340 (+ 512us) server_negotiation.cc:299] Negotiation successful
0620 14:56:12.781442 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260620 14:56:12.781792 16003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:12.767849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36145 (local address 127.12.116.129:33959)
0620 14:56:12.768189 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:12.768251 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:12.769148 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:12.769618 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:12.769628 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:12.770397 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:12.770648 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:12.770654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.771582 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.771583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:12.772692 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:12.772695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.773284 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.773287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:12.773576 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:12.774382 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:12.774395 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:12.776240 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:12.778242 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:12.778255 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:12.778258 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:12.779112 (+ 854us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:12.779850 (+ 738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:12.779852 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:12.779853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:12.780094 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:12.780856 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:12.780869 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:12.781113 (+ 244us) client_negotiation.cc:769] Sending connection context
0620 14:56:12.781250 (+ 137us) client_negotiation.cc:240] Negotiation successful
0620 14:56:12.781486 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":133,"threads_started":1}
I20260620 14:56:12.782649 16001 heartbeater.cc:347] Connected to a master server at 127.12.116.190:36145
I20260620 14:56:12.782759 16001 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:12.783015 16001 heartbeater.cc:511] Master 127.12.116.190:36145 requested a full tablet report, sending...
I20260620 14:56:12.783772 15810 ts_manager.cc:194] Registered new tserver with Master: b2029dd6cd38458abb0c2e1f489b9407 (127.12.116.129:45773)
I20260620 14:56:12.784869 15810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:33959
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:12.813071 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36145
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:12.911378 16006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:12.911648 16006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:12.911677 16006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:12.913094 16006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:12.913161 16006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:12.913193 16006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:12.914894 16006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:12.915165 16006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:12.915388 16006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:12.922256 16014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:12.922237 16011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:12.922237 16012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:12.923020 16006 server_base.cc:1034] running on GCE node
I20260620 14:56:12.923383 16006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:12.923789 16006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:12.925012 16006 hybrid_clock.cc:648] HybridClock initialized: now 1781967372924937 us; error 117 us; skew 500 ppm
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:12.934511 16006 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:12.935089 16006 webserver.cc:460] Webserver started at http://127.12.116.130:43253/ using document root <none> and password file <none>
I20260620 14:56:12.935344 16006 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:12.935395 16006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:12.935500 16006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:12.936803 16006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "360e61fa53f040a2a6f2125b0618cdcf"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "5d2e408b0f017bf802ad802e0ccce1cd"
server_key_iv: "e12e660e7d1d00170679e1098445ead4"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.937203 16006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "360e61fa53f040a2a6f2125b0618cdcf"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "5d2e408b0f017bf802ad802e0ccce1cd"
server_key_iv: "e12e660e7d1d00170679e1098445ead4"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.938957 16006 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:12.940292 16021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.940584 16006 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:12.940692 16006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "360e61fa53f040a2a6f2125b0618cdcf"
format_stamp: "Formatted at 2026-06-20 14:56:12 on dist-test-slave-7v06"
server_key: "5d2e408b0f017bf802ad802e0ccce1cd"
server_key_iv: "e12e660e7d1d00170679e1098445ead4"
server_key_version: "encryptionkey@0"
I20260620 14:56:12.940757 16006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:12.954206 16006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:12.956866 16006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:12.957028 16006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:12.957304 16006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:12.957647 16006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:12.957702 16006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.957739 16006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:12.957767 16006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:12.964584 16006 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:38909
I20260620 14:56:12.964617 16134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:38909 every 8 connection(s)
I20260620 14:56:12.964995 16006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:12.969882 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16006
I20260620 14:56:12.969990 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:12.970216 12754 external_mini_cluster.cc:1428] Setting key 77046aa1252b51d22887aa0426e6cbe7
Jun 20 14:56:12 dist-test-slave-7v06 krb5kdc[15765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:12.975611 15849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:12.965874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:53501 (local address 127.12.116.190:36145)
0620 14:56:12.966079 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:12.966081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:12.966274 (+ 193us) server_negotiation.cc:407] Connection header received
0620 14:56:12.966827 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:12.966828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:12.966839 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:12.966893 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:12.967886 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.968474 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.969516 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.969717 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.969792 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:12.972239 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:12.972240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:12.972241 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:12.972249 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:12.973917 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:12.974537 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:12.974539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:12.974539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:12.974605 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:12.974916 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:12.974917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:12.974918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:12.975050 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:12.975128 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:12.975420 (+ 292us) server_negotiation.cc:299] Negotiation successful
0620 14:56:12.975510 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260620 14:56:12.975833 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:12.965793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36145 (local address 127.12.116.130:53501)
0620 14:56:12.966115 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:12.966186 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:12.966720 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:12.966976 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:12.966984 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:12.967578 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:12.967787 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:12.967791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.968574 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.968575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:12.969411 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:12.969413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:12.969799 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:12.969800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:12.969935 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:12.970607 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:12.970618 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:12.972126 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:12.974057 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:12.974067 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:12.974070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:12.974421 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:12.974722 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:12.974723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:12.974723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:12.974847 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:12.975116 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:12.975122 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:12.975286 (+ 164us) client_negotiation.cc:769] Sending connection context
0620 14:56:12.975398 (+ 112us) client_negotiation.cc:240] Negotiation successful
0620 14:56:12.975580 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":98,"threads_started":1}
I20260620 14:56:12.976485 16135 heartbeater.cc:347] Connected to a master server at 127.12.116.190:36145
I20260620 14:56:12.976588 16135 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:12.976796 16135 heartbeater.cc:511] Master 127.12.116.190:36145 requested a full tablet report, sending...
I20260620 14:56:12.977222 15810 ts_manager.cc:194] Registered new tserver with Master: 360e61fa53f040a2a6f2125b0618cdcf (127.12.116.130:38909)
I20260620 14:56:12.977816 15810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:53501
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:13.009071 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36145
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:13.115204 16140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:13.115509 16140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:13.115556 16140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:13.117152 16140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:13.117259 16140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:13.117316 16140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:13.119282 16140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:13.119685 16140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:13.119964 16140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:13.128008 16146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:13.128363 16148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:13.128397 16145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:13.128829 16140 server_base.cc:1034] running on GCE node
I20260620 14:56:13.129102 16140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:13.129674 16140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:13.130939 16140 hybrid_clock.cc:648] HybridClock initialized: now 1781967373130880 us; error 80 us; skew 500 ppm
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[15765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967373, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:13.134527 16140 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:13.135751 16140 webserver.cc:460] Webserver started at http://127.12.116.131:36945/ using document root <none> and password file <none>
I20260620 14:56:13.136042 16140 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:13.136094 16140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:13.136202 16140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:13.137567 16140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "0945c73c790f42d096bb62ca805e62fb"
format_stamp: "Formatted at 2026-06-20 14:56:13 on dist-test-slave-7v06"
server_key: "1adff339c7199cccd37d7f2463a41ba5"
server_key_iv: "ba57e90ad3f4f201c12751fe322c1891"
server_key_version: "encryptionkey@0"
I20260620 14:56:13.137984 16140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "0945c73c790f42d096bb62ca805e62fb"
format_stamp: "Formatted at 2026-06-20 14:56:13 on dist-test-slave-7v06"
server_key: "1adff339c7199cccd37d7f2463a41ba5"
server_key_iv: "ba57e90ad3f4f201c12751fe322c1891"
server_key_version: "encryptionkey@0"
I20260620 14:56:13.139763 16140 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:13.141594 16155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:13.141855 16140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:13.141970 16140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "0945c73c790f42d096bb62ca805e62fb"
format_stamp: "Formatted at 2026-06-20 14:56:13 on dist-test-slave-7v06"
server_key: "1adff339c7199cccd37d7f2463a41ba5"
server_key_iv: "ba57e90ad3f4f201c12751fe322c1891"
server_key_version: "encryptionkey@0"
I20260620 14:56:13.142289 16140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:13.173255 16140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:13.177254 16140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:13.177443 16140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:13.177770 16140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:13.180683 16140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:13.180801 16140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:13.180855 16140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:13.180882 16140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:13.192191 16140 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:40069
I20260620 14:56:13.192292 16268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:40069 every 8 connection(s)
I20260620 14:56:13.192698 16140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:13.196741 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16140
I20260620 14:56:13.196898 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:13.197163 12754 external_mini_cluster.cc:1428] Setting key 30f5d913ed33b6e6f957550e498e318f
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[15765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967373, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:13.211905 15849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:13.193981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:51145 (local address 127.12.116.190:36145)
0620 14:56:13.194032 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:13.194035 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:13.194365 (+ 330us) server_negotiation.cc:407] Connection header received
0620 14:56:13.195423 (+ 1058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:13.195425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:13.195445 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:13.195542 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:13.197372 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:13.198212 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:13.200106 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:13.200477 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:13.200531 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:13.207283 (+ 6752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:13.207287 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:13.207288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:13.207298 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:13.209744 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:13.210349 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:13.210351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:13.210351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:13.210431 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:13.210785 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:13.210786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:13.210787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:13.211105 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:13.211317 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:13.211698 (+ 381us) server_negotiation.cc:299] Negotiation successful
0620 14:56:13.211800 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:56:13.212163 16271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:13.193584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36145 (local address 127.12.116.131:51145)
0620 14:56:13.194123 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:13.194232 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:13.195237 (+ 1005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:13.195650 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:13.195655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:13.196833 (+ 1178us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:13.197218 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:13.197229 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:13.198342 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:13.198343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:13.199945 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:13.199951 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:13.200650 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:13.200651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:13.201419 (+ 768us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:13.204736 (+ 3317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:13.204764 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:13.207089 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:13.209827 (+ 2738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:13.209841 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:13.209846 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:13.210208 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:13.210518 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:13.210520 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:13.210520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:13.210676 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:13.211304 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:13.211313 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:13.211543 (+ 230us) client_negotiation.cc:769] Sending connection context
0620 14:56:13.211676 (+ 133us) client_negotiation.cc:240] Negotiation successful
0620 14:56:13.211871 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260620 14:56:13.212674 16269 heartbeater.cc:347] Connected to a master server at 127.12.116.190:36145
I20260620 14:56:13.212780 16269 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:13.212992 16269 heartbeater.cc:511] Master 127.12.116.190:36145 requested a full tablet report, sending...
I20260620 14:56:13.213387 15810 ts_manager.cc:194] Registered new tserver with Master: 0945c73c790f42d096bb62ca805e62fb (127.12.116.131:40069)
I20260620 14:56:13.213929 15810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:51145
I20260620 14:56:13.220583 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[15765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967373, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[15765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967373, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:13.253623 15849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:13.241700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.12.116.190:36145)
0620 14:56:13.241766 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:13.241768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:13.241875 (+ 107us) server_negotiation.cc:407] Connection header received
0620 14:56:13.241986 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:13.241987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:13.242001 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:13.242062 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:13.242686 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:13.243216 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:13.244029 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:13.244237 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:13.244319 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:13.248480 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:13.248483 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:13.248483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:13.248494 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:13.250987 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:13.252056 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:13.252059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:13.252059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:13.252155 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:13.252522 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:13.252523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:13.252523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:13.253026 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:13.253198 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:13.253426 (+ 228us) server_negotiation.cc:299] Negotiation successful
0620 14:56:13.253544 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260620 14:56:13.254056 15810 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57188
I20260620 14:56:13.254920 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15872
I20260620 14:56:13.261853 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16006
I20260620 14:56:13.267429 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16140
I20260620 14:56:13.272830 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 15778
2026-06-20T14:56:13Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2173 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[16281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[16281](info): set up 2 sockets
Jun 20 14:56:13 dist-test-slave-7v06 krb5kdc[16281](info): commencing operation
krb5kdc: starting...
W20260620 14:56:14.448912 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:14 dist-test-slave-7v06 krb5kdc[16281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:14.624647 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43317
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43317
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:14.711298 16294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:14.711585 16294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:14.711630 16294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:14.713255 16294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:14.713362 16294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:14.713392 16294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:14.713415 16294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:14.713444 16294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:14.715807 16294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:14.716181 16294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:14.716455 16294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:14.721875 16300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:14.721879 16302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:14.721875 16299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:14.722229 16294 server_base.cc:1034] running on GCE node
I20260620 14:56:14.722472 16294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:14.722800 16294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:14.724072 16294 hybrid_clock.cc:648] HybridClock initialized: now 1781967374724074 us; error 60 us; skew 500 ppm
Jun 20 14:56:14 dist-test-slave-7v06 krb5kdc[16281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967374, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:14.730960 16294 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:14.731618 16294 webserver.cc:460] Webserver started at http://127.12.116.190:45175/ using document root <none> and password file <none>
I20260620 14:56:14.731874 16294 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:14.731946 16294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:14.732110 16294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:14.733418 16294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "b56ff7b720c84086ac209ef29fbf0a35"
format_stamp: "Formatted at 2026-06-20 14:56:14 on dist-test-slave-7v06"
server_key: "b6fedf6b6479738203513dd8fd1bca5b"
server_key_iv: "02720d91ee83fc724834275b457409da"
server_key_version: "encryptionkey@0"
I20260620 14:56:14.733832 16294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "b56ff7b720c84086ac209ef29fbf0a35"
format_stamp: "Formatted at 2026-06-20 14:56:14 on dist-test-slave-7v06"
server_key: "b6fedf6b6479738203513dd8fd1bca5b"
server_key_iv: "02720d91ee83fc724834275b457409da"
server_key_version: "encryptionkey@0"
I20260620 14:56:14.735750 16294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260620 14:56:14.737136 16309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:14.737454 16294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:14.737609 16294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "b56ff7b720c84086ac209ef29fbf0a35"
format_stamp: "Formatted at 2026-06-20 14:56:14 on dist-test-slave-7v06"
server_key: "b6fedf6b6479738203513dd8fd1bca5b"
server_key_iv: "02720d91ee83fc724834275b457409da"
server_key_version: "encryptionkey@0"
I20260620 14:56:14.737699 16294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:14.775501 16294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:14.778633 16294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:14.778889 16294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:14.784075 16294 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43317
I20260620 14:56:14.784152 16361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43317 every 8 connection(s)
I20260620 14:56:14.784768 16294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:14.785645 16362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:14.788273 16362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35: Bootstrap starting.
I20260620 14:56:14.789043 16362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:14.789328 16362 log.cc:824] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:14.790163 16362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35: No bootstrap required, opened a new log
I20260620 14:56:14.791491 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16294
I20260620 14:56:14.791692 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:14.791909 12754 external_mini_cluster.cc:1428] Setting key 9cd4f5414e5359a8297b17f2d731e071
I20260620 14:56:14.792147 16362 raft_consensus.cc:348] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b56ff7b720c84086ac209ef29fbf0a35" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43317 } }
I20260620 14:56:14.792390 16362 raft_consensus.cc:374] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:14.792469 16362 raft_consensus.cc:729] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ff7b720c84086ac209ef29fbf0a35, State: Initialized, Role: FOLLOWER
I20260620 14:56:14.792677 16362 consensus_queue.cc:260] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b56ff7b720c84086ac209ef29fbf0a35" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43317 } }
I20260620 14:56:14.792788 16362 raft_consensus.cc:388] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:14.792829 16362 raft_consensus.cc:482] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:14.792889 16362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:14.793701 16362 raft_consensus.cc:504] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b56ff7b720c84086ac209ef29fbf0a35" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43317 } }
I20260620 14:56:14.793848 16362 leader_election.cc:302] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b56ff7b720c84086ac209ef29fbf0a35; no voters:
I20260620 14:56:14.794049 16362 leader_election.cc:288] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:14.794078 16367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:14.794200 16367 raft_consensus.cc:686] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [term 1 LEADER]: Becoming Leader. State: Replica: b56ff7b720c84086ac209ef29fbf0a35, State: Running, Role: LEADER
I20260620 14:56:14.794366 16362 sys_catalog.cc:564] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:14.794360 16367 consensus_queue.cc:237] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b56ff7b720c84086ac209ef29fbf0a35" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43317 } }
I20260620 14:56:14.796849 16369 sys_catalog.cc:455] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b56ff7b720c84086ac209ef29fbf0a35. Latest consensus state: current_term: 1 leader_uuid: "b56ff7b720c84086ac209ef29fbf0a35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b56ff7b720c84086ac209ef29fbf0a35" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43317 } } }
I20260620 14:56:14.797001 16369 sys_catalog.cc:458] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:14.797348 16368 sys_catalog.cc:455] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b56ff7b720c84086ac209ef29fbf0a35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b56ff7b720c84086ac209ef29fbf0a35" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43317 } } }
I20260620 14:56:14.797449 16368 sys_catalog.cc:458] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:14.797529 16381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:14.798332 16381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:14.800421 16381 catalog_manager.cc:1347] Generated new cluster ID: 5b875629ba6b4a11a69955bf1c9d0f94
I20260620 14:56:14.800510 16381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:56:14 dist-test-slave-7v06 krb5kdc[16281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:14.806895 16366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:14.792523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42516 (local address 127.12.116.190:43317)
0620 14:56:14.793266 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:14.793277 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:14.793311 (+ 34us) server_negotiation.cc:407] Connection header received
0620 14:56:14.793438 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:14.793445 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:14.793494 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:14.793763 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:14.794623 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:14.796253 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:14.797245 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:14.797932 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:14.798063 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:14.801790 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:14.801796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:14.801796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:14.801814 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:14.804165 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:14.804776 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:14.804780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:14.804781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:14.804936 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:14.805176 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:14.805177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:14.805177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:14.805584 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:14.806338 (+ 754us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:14.806450 (+ 112us) server_negotiation.cc:299] Negotiation successful
0620 14:56:14.806653 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":613,"threads_started":1}
I20260620 14:56:14.815692 16381 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:14.816648 16381 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:14.829214 16381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b56ff7b720c84086ac209ef29fbf0a35: Generated new TSK 0
I20260620 14:56:14.829659 16381 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:14.870095 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43317
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:14.976051 16388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:14.976395 16388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:14.976444 16388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:14.979143 16388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:14.979278 16388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:14.979341 16388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:14.981776 16388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:14.982156 16388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:14.982461 16388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:14.988595 16393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:14.988585 16394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:14.988585 16396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:14.988607 16388 server_base.cc:1034] running on GCE node
I20260620 14:56:14.989169 16388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:14.989517 16388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:14.990751 16388 hybrid_clock.cc:648] HybridClock initialized: now 1781967374990708 us; error 67 us; skew 500 ppm
Jun 20 14:56:14 dist-test-slave-7v06 krb5kdc[16281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967374, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:14.994449 16388 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:14.995280 16388 webserver.cc:460] Webserver started at http://127.12.116.129:41569/ using document root <none> and password file <none>
I20260620 14:56:14.995563 16388 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:14.995641 16388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:14.995826 16388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:14.997255 16388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "6acbcca85afc401fa6cf0233e84f0e43"
format_stamp: "Formatted at 2026-06-20 14:56:14 on dist-test-slave-7v06"
server_key: "b051dcc5f20385248d965ca44b30e034"
server_key_iv: "95e471b7087e125c60c3a9bce32dc455"
server_key_version: "encryptionkey@0"
I20260620 14:56:14.997711 16388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "6acbcca85afc401fa6cf0233e84f0e43"
format_stamp: "Formatted at 2026-06-20 14:56:14 on dist-test-slave-7v06"
server_key: "b051dcc5f20385248d965ca44b30e034"
server_key_iv: "95e471b7087e125c60c3a9bce32dc455"
server_key_version: "encryptionkey@0"
I20260620 14:56:14.999712 16388 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260620 14:56:15.000948 16403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.001345 16388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:15.001485 16388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "6acbcca85afc401fa6cf0233e84f0e43"
format_stamp: "Formatted at 2026-06-20 14:56:14 on dist-test-slave-7v06"
server_key: "b051dcc5f20385248d965ca44b30e034"
server_key_iv: "95e471b7087e125c60c3a9bce32dc455"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.001588 16388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:15.012502 16388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:15.014874 16388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:15.015077 16388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:15.015360 16388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:15.015748 16388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:15.015805 16388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.015841 16388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:15.015868 16388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.022863 16388 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:35815
I20260620 14:56:15.022902 16516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:35815 every 8 connection(s)
I20260620 14:56:15.023272 16388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:15.028657 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16388
I20260620 14:56:15.028800 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:15.029136 12754 external_mini_cluster.cc:1428] Setting key 9a7bf6efd829af0ea7bc768e611aca1e
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967374, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:15.035835 16366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.024062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:52307 (local address 127.12.116.190:43317)
0620 14:56:15.024136 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:15.024139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:15.024470 (+ 331us) server_negotiation.cc:407] Connection header received
0620 14:56:15.025455 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:15.025457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:15.025481 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:15.025548 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:15.026252 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.026774 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.027905 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.028220 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.028429 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.031630 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:15.031633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:15.031633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:15.031651 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:15.033616 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.034533 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.034534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.034534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.034609 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.035055 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.035056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.035057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.035205 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:15.035286 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:15.035604 (+ 318us) server_negotiation.cc:299] Negotiation successful
0620 14:56:15.035734 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 14:56:15.036058 16519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.024034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43317 (local address 127.12.116.129:52307)
0620 14:56:15.024225 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:15.024269 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:15.025292 (+ 1023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:15.025609 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:15.025613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:15.025907 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:15.026129 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:15.026133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.026877 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.026878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:15.027746 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:15.027749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.028442 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.028443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:15.028585 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.029404 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:15.029419 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:15.031510 (+ 2091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:15.033782 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:15.033802 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:15.033805 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:15.034245 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:15.034802 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:15.034804 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:15.034804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:15.034963 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:15.035277 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:15.035285 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:15.035445 (+ 160us) client_negotiation.cc:769] Sending connection context
0620 14:56:15.035557 (+ 112us) client_negotiation.cc:240] Negotiation successful
0620 14:56:15.035744 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260620 14:56:15.037081 16517 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43317
I20260620 14:56:15.037221 16517 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:15.037462 16517 heartbeater.cc:511] Master 127.12.116.190:43317 requested a full tablet report, sending...
I20260620 14:56:15.038363 16326 ts_manager.cc:194] Registered new tserver with Master: 6acbcca85afc401fa6cf0233e84f0e43 (127.12.116.129:35815)
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:56:15.039271 16326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:52307
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:15.062330 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43317
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:15.181188 16522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:15.181493 16522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:15.181535 16522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:15.183722 16522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:15.183825 16522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:15.183866 16522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:15.186231 16522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:15.186578 16522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:15.186861 16522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:15.193121 16528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:15.193121 16530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:15.193152 16527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:15.194052 16522 server_base.cc:1034] running on GCE node
I20260620 14:56:15.194335 16522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:15.194737 16522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:15.195950 16522 hybrid_clock.cc:648] HybridClock initialized: now 1781967375195932 us; error 32 us; skew 500 ppm
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:15.199642 16522 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:15.200292 16522 webserver.cc:460] Webserver started at http://127.12.116.130:40705/ using document root <none> and password file <none>
I20260620 14:56:15.200620 16522 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:15.200678 16522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:15.200789 16522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:15.201989 16522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "bd8414a847d249febcc4295d68b203e8"
format_stamp: "Formatted at 2026-06-20 14:56:15 on dist-test-slave-7v06"
server_key: "190afeb5a4a977377a1bc5a98e37062f"
server_key_iv: "821ca9a72df67bef1bb21b89657e9c7f"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.202477 16522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "bd8414a847d249febcc4295d68b203e8"
format_stamp: "Formatted at 2026-06-20 14:56:15 on dist-test-slave-7v06"
server_key: "190afeb5a4a977377a1bc5a98e37062f"
server_key_iv: "821ca9a72df67bef1bb21b89657e9c7f"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.204425 16522 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260620 14:56:15.205709 16537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.206091 16522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:15.206193 16522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "bd8414a847d249febcc4295d68b203e8"
format_stamp: "Formatted at 2026-06-20 14:56:15 on dist-test-slave-7v06"
server_key: "190afeb5a4a977377a1bc5a98e37062f"
server_key_iv: "821ca9a72df67bef1bb21b89657e9c7f"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.206332 16522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:15.223431 16522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:15.226719 16522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:15.226904 16522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:15.227205 16522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:15.227581 16522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:15.227638 16522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.227839 16522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:15.227924 16522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.236487 16522 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:42947
I20260620 14:56:15.236563 16650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:42947 every 8 connection(s)
I20260620 14:56:15.236943 16522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:15.239547 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16522
I20260620 14:56:15.239751 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:15.239934 12754 external_mini_cluster.cc:1428] Setting key 3320d49f8e835d1d5031ef83a41d2c05
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:56:15.250778 16366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.238163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:53159 (local address 127.12.116.190:43317)
0620 14:56:15.238260 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:15.238262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:15.238274 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:15.239248 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:15.239249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:15.239261 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:15.239333 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:15.240272 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.241091 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.242879 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.243286 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.243385 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.246671 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:15.246672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:15.246673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:15.246681 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:15.248695 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.249385 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.249386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.249386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.249458 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.249823 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.249824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.249825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.250032 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:15.250101 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:15.250586 (+ 485us) server_negotiation.cc:299] Negotiation successful
0620 14:56:15.250697 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260620 14:56:15.251348 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.237867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43317 (local address 127.12.116.130:53159)
0620 14:56:15.238108 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:15.238156 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:15.239094 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:15.239416 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:15.239420 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:15.239747 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:15.240087 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:15.240094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.241218 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.241220 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:15.242757 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:15.242761 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.243414 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.243415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:15.243546 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.244317 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:15.244547 (+ 230us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:15.246510 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:15.248829 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:15.248846 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:15.248850 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:15.249265 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:15.249545 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:15.249546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:15.249547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:15.249718 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:15.250109 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:15.250116 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:15.250329 (+ 213us) client_negotiation.cc:769] Sending connection context
0620 14:56:15.250465 (+ 136us) client_negotiation.cc:240] Negotiation successful
0620 14:56:15.250959 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":152,"threads_started":1}
I20260620 14:56:15.252887 16651 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43317
I20260620 14:56:15.253021 16651 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:15.253207 16651 heartbeater.cc:511] Master 127.12.116.190:43317 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
I20260620 14:56:15.253829 16326 ts_manager.cc:194] Registered new tserver with Master: bd8414a847d249febcc4295d68b203e8 (127.12.116.130:42947)
I20260620 14:56:15.254299 16326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:53159
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:15.277033 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43317
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:15.384423 16656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:15.384997 16656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:15.385154 16656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:15.387446 16656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:15.387569 16656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:15.387625 16656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:15.391595 16656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:15.392269 16656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:15.392695 16656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:15.400880 16662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:15.400840 16664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:15.401049 16661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:15.400862 16656 server_base.cc:1034] running on GCE node
I20260620 14:56:15.401350 16656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:15.401715 16656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:15.403034 16656 hybrid_clock.cc:648] HybridClock initialized: now 1781967375403007 us; error 40 us; skew 500 ppm
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:15.407379 16656 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:15.408233 16656 webserver.cc:460] Webserver started at http://127.12.116.131:37853/ using document root <none> and password file <none>
I20260620 14:56:15.408597 16656 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:15.408656 16656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:15.408779 16656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:15.410295 16656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "d2930295c6d94d45b1f63c3820b5bebe"
format_stamp: "Formatted at 2026-06-20 14:56:15 on dist-test-slave-7v06"
server_key: "5f143981ef75e00ef5737a6e3c3c8010"
server_key_iv: "028ca7d6ae70ecb2239d88e3c2404530"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.410750 16656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "d2930295c6d94d45b1f63c3820b5bebe"
format_stamp: "Formatted at 2026-06-20 14:56:15 on dist-test-slave-7v06"
server_key: "5f143981ef75e00ef5737a6e3c3c8010"
server_key_iv: "028ca7d6ae70ecb2239d88e3c2404530"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.412777 16656 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:56:15.414153 16671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.414529 16656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:15.414681 16656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "d2930295c6d94d45b1f63c3820b5bebe"
format_stamp: "Formatted at 2026-06-20 14:56:15 on dist-test-slave-7v06"
server_key: "5f143981ef75e00ef5737a6e3c3c8010"
server_key_iv: "028ca7d6ae70ecb2239d88e3c2404530"
server_key_version: "encryptionkey@0"
I20260620 14:56:15.414846 16656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:15.430805 16656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:15.435420 16656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:15.435617 16656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:15.436031 16656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:15.436561 16656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:15.436930 16656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.437067 16656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:15.437301 16656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:15.445086 16656 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:44713
I20260620 14:56:15.445282 16784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:44713 every 8 connection(s)
I20260620 14:56:15.445591 16656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:15.454835 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16656
I20260620 14:56:15.454952 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:15.455225 12754 external_mini_cluster.cc:1428] Setting key 753e13abc55fca24df5950441616aa3a
I20260620 14:56:15.460283 16366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.446679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:60399 (local address 127.12.116.190:43317)
0620 14:56:15.446774 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:15.446776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:15.446999 (+ 223us) server_negotiation.cc:407] Connection header received
0620 14:56:15.448125 (+ 1126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:15.448126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:15.448143 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:15.448198 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:15.449025 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.449681 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.450868 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.451085 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.451190 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.453890 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:15.453893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:15.453893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:15.453902 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:15.457042 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.457739 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.457741 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.457742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.457862 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.458288 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.458289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.458289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.458476 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:15.458833 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:15.460091 (+ 1258us) server_negotiation.cc:299] Negotiation successful
0620 14:56:15.460200 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260620 14:56:15.460834 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.446596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43317 (local address 127.12.116.131:60399)
0620 14:56:15.446841 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:15.446894 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:15.447947 (+ 1053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:15.448303 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:15.448308 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:15.448678 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:15.448903 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:15.448907 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.449831 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.449833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:15.450758 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:15.450760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.451192 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.451193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:15.451358 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.451978 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:15.451988 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:15.453745 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:15.457234 (+ 3489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:15.457248 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:15.457252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:15.457588 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:15.457989 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:15.457990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:15.457990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:15.458149 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:15.458933 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:15.458947 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:15.459500 (+ 553us) client_negotiation.cc:769] Sending connection context
0620 14:56:15.459979 (+ 479us) client_negotiation.cc:240] Negotiation successful
0620 14:56:15.460170 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":81,"threads_started":1}
I20260620 14:56:15.461892 16785 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43317
I20260620 14:56:15.462054 16785 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:15.462298 16785 heartbeater.cc:511] Master 127.12.116.190:43317 requested a full tablet report, sending...
I20260620 14:56:15.463116 16326 ts_manager.cc:194] Registered new tserver with Master: d2930295c6d94d45b1f63c3820b5bebe (127.12.116.131:44713)
I20260620 14:56:15.463569 16326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:60399
I20260620 14:56:15.469597 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:56:15.500856 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.488437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39558 (local address 127.12.116.129:35815)
0620 14:56:15.488655 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:15.488661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:15.488674 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:56:15.488704 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:15.488706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:15.488722 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:15.488803 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:15.489562 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.490375 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.491377 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.491765 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.491850 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.495829 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:15.495846 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:15.495846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:15.495857 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:15.498084 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.498864 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.498868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.498868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.498963 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.499442 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.499443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.499443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.499646 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:15.499902 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:15.500565 (+ 663us) server_negotiation.cc:299] Negotiation successful
0620 14:56:15.500727 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":106,"threads_started":1}
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:15.512944 16366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:15.503043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42518 (local address 127.12.116.190:43317)
0620 14:56:15.503116 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:15.503119 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:15.503130 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:15.503160 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:15.503161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:15.503174 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:15.503247 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:15.503832 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.504472 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.505244 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:15.505506 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:15.505593 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:15.508490 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:15.508493 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:15.508493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:15.508503 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:15.511127 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.511650 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.511651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.511651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.511724 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:15.511924 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:15.511925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:15.511925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:15.512116 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:15.512237 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:15.512391 (+ 154us) server_negotiation.cc:299] Negotiation successful
0620 14:56:15.512492 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260620 14:56:15.513739 16326 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42518
I20260620 14:56:15.515053 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16388
I20260620 14:56:15.521564 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16522
I20260620 14:56:15.527658 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16656
I20260620 14:56:15.534791 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16294
2026-06-20T14:56:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2265 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16797](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16797](info): set up 2 sockets
Jun 20 14:56:15 dist-test-slave-7v06 krb5kdc[16797](info): commencing operation
krb5kdc: starting...
W20260620 14:56:16.676658 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:16 dist-test-slave-7v06 krb5kdc[16797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:16.830039 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:42407
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:42407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:16.934152 16810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:16.934741 16810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:16.934783 16810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:16.936894 16810 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:16.937108 16810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:16.937175 16810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:16.937193 16810 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:16.937208 16810 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:16.940985 16810 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:42407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:42407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:16.941330 16810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:16.941548 16810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:16.947780 16815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:16.947857 16816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:16.947839 16810 server_base.cc:1034] running on GCE node
W20260620 14:56:16.948060 16818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:16.948415 16810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:16.948815 16810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:16.950026 16810 hybrid_clock.cc:648] HybridClock initialized: now 1781967376949993 us; error 50 us; skew 500 ppm
Jun 20 14:56:16 dist-test-slave-7v06 krb5kdc[16797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967376, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:16.953855 16810 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:16.954739 16810 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:16.954821 16810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:16.955200 16810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:16.956713 16810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "a2cc590ac90b4ba7b958c955cee6776e"
format_stamp: "Formatted at 2026-06-20 14:56:16 on dist-test-slave-7v06"
server_key: "5b06e0bde08509fcecad93e4fdb01610"
server_key_iv: "0b7ee66f496b2fcf98d3ebfdcd25fdeb"
server_key_version: "encryptionkey@0"
I20260620 14:56:16.957156 16810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "a2cc590ac90b4ba7b958c955cee6776e"
format_stamp: "Formatted at 2026-06-20 14:56:16 on dist-test-slave-7v06"
server_key: "5b06e0bde08509fcecad93e4fdb01610"
server_key_iv: "0b7ee66f496b2fcf98d3ebfdcd25fdeb"
server_key_version: "encryptionkey@0"
I20260620 14:56:16.959074 16810 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:16.960456 16824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:16.960695 16810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:16.960858 16810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "a2cc590ac90b4ba7b958c955cee6776e"
format_stamp: "Formatted at 2026-06-20 14:56:16 on dist-test-slave-7v06"
server_key: "5b06e0bde08509fcecad93e4fdb01610"
server_key_iv: "0b7ee66f496b2fcf98d3ebfdcd25fdeb"
server_key_version: "encryptionkey@0"
I20260620 14:56:16.960970 16810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:16.974529 16810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:16.979512 16810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:16.979812 16810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:16.984437 16810 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:42407
I20260620 14:56:16.984508 16876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:42407 every 8 connection(s)
I20260620 14:56:16.984829 16810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:16.985960 16877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:16.988955 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16810
I20260620 14:56:16.989061 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:16.989300 12754 external_mini_cluster.cc:1428] Setting key 712cca97caaf23d6c687b9ced79a3c3a
I20260620 14:56:16.990557 16877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e: Bootstrap starting.
I20260620 14:56:16.991325 16877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:16.991662 16877 log.cc:824] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:16.992887 16877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e: No bootstrap required, opened a new log
I20260620 14:56:16.995096 16877 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2cc590ac90b4ba7b958c955cee6776e" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42407 } }
I20260620 14:56:16.995316 16877 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:16.995373 16877 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2cc590ac90b4ba7b958c955cee6776e, State: Initialized, Role: FOLLOWER
I20260620 14:56:16.995517 16877 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2cc590ac90b4ba7b958c955cee6776e" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42407 } }
I20260620 14:56:16.995709 16877 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:16.995848 16877 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:16.995932 16877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:16.997381 16877 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2cc590ac90b4ba7b958c955cee6776e" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42407 } }
I20260620 14:56:16.997596 16877 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2cc590ac90b4ba7b958c955cee6776e; no voters:
I20260620 14:56:16.998013 16877 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:16.998051 16882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:16.998203 16882 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [term 1 LEADER]: Becoming Leader. State: Replica: a2cc590ac90b4ba7b958c955cee6776e, State: Running, Role: LEADER
I20260620 14:56:16.998394 16882 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2cc590ac90b4ba7b958c955cee6776e" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42407 } }
I20260620 14:56:16.998462 16877 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [sys.catalog]: configured and running, proceeding with master startup.
Jun 20 14:56:16 dist-test-slave-7v06 krb5kdc[16797](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:16.999087 16884 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2cc590ac90b4ba7b958c955cee6776e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2cc590ac90b4ba7b958c955cee6776e" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42407 } } }
I20260620 14:56:16.999300 16884 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:16.999745 16888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:16.999820 16883 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2cc590ac90b4ba7b958c955cee6776e. Latest consensus state: current_term: 1 leader_uuid: "a2cc590ac90b4ba7b958c955cee6776e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2cc590ac90b4ba7b958c955cee6776e" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42407 } } }
I20260620 14:56:16.999969 16883 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:17.001783 16888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:17.003808 16888 catalog_manager.cc:1347] Generated new cluster ID: db46911ed2cc4cfc9ad6fc27bbf93f2a
I20260620 14:56:17.003871 16888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:17.004096 16880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:16.990198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57278 (local address 127.12.116.190:42407)
0620 14:56:16.990486 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:16.990502 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:16.990550 (+ 48us) server_negotiation.cc:407] Connection header received
0620 14:56:16.991346 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:16.991358 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:16.991449 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:16.991675 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:16.992990 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:16.994415 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:16.995335 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:16.996003 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:16.996130 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:16.999508 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:16.999515 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:16.999515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:16.999533 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:17.002174 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.002663 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.002667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.002667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.002788 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.003043 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.003044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.003045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.003421 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:17.003582 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.003705 (+ 123us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.003868 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":102,"threads_started":1}
I20260620 14:56:17.032907 16888 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:17.033561 16888 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:17.040632 16888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e: Generated new TSK 0
I20260620 14:56:17.040899 16888 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:17.089046 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:42407
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:17.201229 16903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:17.201509 16903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:17.201540 16903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:17.202939 16903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:17.202991 16903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:17.203024 16903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:17.204896 16903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:17.205152 16903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:17.205363 16903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:17.210831 16908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:17.210870 16911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:17.210831 16909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.211154 16903 server_base.cc:1034] running on GCE node
I20260620 14:56:17.211386 16903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:17.211690 16903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:17.212922 16903 hybrid_clock.cc:648] HybridClock initialized: now 1781967377212986 us; error 222 us; skew 500 ppm
Jun 20 14:56:17 dist-test-slave-7v06 krb5kdc[16797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:17.216605 16903 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:17.217064 16903 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:17.217147 16903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:17.217311 16903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:17.218470 16903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "53f4d6ec3a16400c96a53864554ac14c"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "2890f1b5945c9b093c75dd0093f870bb"
server_key_iv: "149b962e473f198a6f2712b86d220515"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.218873 16903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "53f4d6ec3a16400c96a53864554ac14c"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "2890f1b5945c9b093c75dd0093f870bb"
server_key_iv: "149b962e473f198a6f2712b86d220515"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.220454 16903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:17.221527 16917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.221875 16903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:17.222002 16903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "53f4d6ec3a16400c96a53864554ac14c"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "2890f1b5945c9b093c75dd0093f870bb"
server_key_iv: "149b962e473f198a6f2712b86d220515"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.222103 16903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:17.237076 16903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:17.239966 16903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:17.240267 16903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:17.240566 16903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:17.240937 16903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:17.240990 16903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.241034 16903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:17.241077 16903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.249084 16903 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:42103
I20260620 14:56:17.249179 17030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:42103 every 8 connection(s)
I20260620 14:56:17.249501 16903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:17.257807 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 16903
I20260620 14:56:17.257970 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:17.258231 12754 external_mini_cluster.cc:1428] Setting key 02badb9fbe76b123165ff72ab9d25a91
Jun 20 14:56:17 dist-test-slave-7v06 krb5kdc[16797](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:17.263639 16880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.250527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:37913 (local address 127.12.116.190:42407)
0620 14:56:17.250758 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.250762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.250912 (+ 150us) server_negotiation.cc:407] Connection header received
0620 14:56:17.251500 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.251502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.251516 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.251815 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:17.253082 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.253725 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.255314 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.255815 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.255941 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.259704 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:17.259706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:17.259706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:17.259716 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:17.261694 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.262334 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.262335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.262335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.262406 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.262728 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.262729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.262729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.262882 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:17.262947 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.263402 (+ 455us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.263541 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260620 14:56:17.263875 17033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.250404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:42407 (local address 127.12.116.129:37913)
0620 14:56:17.250687 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.250745 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.251324 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.251907 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.251912 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.252257 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:17.252904 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.252911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.253906 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.253907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.255147 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.255152 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.256006 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.256008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.256208 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.257304 (+ 1096us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:17.257318 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:17.259588 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:17.261815 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:17.261828 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:17.261833 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:17.262214 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:17.262487 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:17.262488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:17.262488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:17.262658 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:17.262958 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:17.262965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:17.263185 (+ 220us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.263339 (+ 154us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.263589 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":114,"threads_started":1}
I20260620 14:56:17.264555 17031 heartbeater.cc:347] Connected to a master server at 127.12.116.190:42407
I20260620 14:56:17.264732 17031 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:17.264935 17031 heartbeater.cc:511] Master 127.12.116.190:42407 requested a full tablet report, sending...
I20260620 14:56:17.265682 16841 ts_manager.cc:194] Registered new tserver with Master: 53f4d6ec3a16400c96a53864554ac14c (127.12.116.129:42103)
I20260620 14:56:17.266728 16841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:37913
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:17.292079 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:42407
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:17.389755 17036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:17.390024 17036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:17.390054 17036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:17.391546 17036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:17.391624 17036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:17.391659 17036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:17.393908 17036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:17.394641 17036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:17.395017 17036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:17.403035 17041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.403209 17036 server_base.cc:1034] running on GCE node
W20260620 14:56:17.403064 17042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:17.403040 17044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.403537 17036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:17.403833 17036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:17.405048 17036 hybrid_clock.cc:648] HybridClock initialized: now 1781967377405023 us; error 36 us; skew 500 ppm
Jun 20 14:56:17 dist-test-slave-7v06 krb5kdc[16797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:17.408138 17036 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:17.408646 17036 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:17.408703 17036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:17.408876 17036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:17.410080 17036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "0a5bfaa515c647c3996639649362e109"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "439f578aa3e9077f29b4e282f09ab0a4"
server_key_iv: "fac71385c1532c6dc3448c5011b69886"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.410495 17036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "0a5bfaa515c647c3996639649362e109"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "439f578aa3e9077f29b4e282f09ab0a4"
server_key_iv: "fac71385c1532c6dc3448c5011b69886"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.413365 17036 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260620 14:56:17.415520 17050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.415803 17036 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.001s
I20260620 14:56:17.415900 17036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "0a5bfaa515c647c3996639649362e109"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "439f578aa3e9077f29b4e282f09ab0a4"
server_key_iv: "fac71385c1532c6dc3448c5011b69886"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.415993 17036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:17.429883 17036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:17.433686 17036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:17.433853 17036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:17.434227 17036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:17.434734 17036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:17.434778 17036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.434806 17036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:17.434819 17036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.442369 17036 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:33339
I20260620 14:56:17.442564 17163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:33339 every 8 connection(s)
I20260620 14:56:17.442867 17036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:17.449623 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17036
I20260620 14:56:17.449769 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:17.450006 12754 external_mini_cluster.cc:1428] Setting key 69b57da089c32d55039ec8a8dab09a8e
Jun 20 14:56:17 dist-test-slave-7v06 krb5kdc[16797](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:17.456797 16880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.443931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:38325 (local address 127.12.116.190:42407)
0620 14:56:17.443988 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.443990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.444228 (+ 238us) server_negotiation.cc:407] Connection header received
0620 14:56:17.444870 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.444871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.444884 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.444957 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:17.446157 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.447007 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.448389 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.448630 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.448712 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.452562 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:17.452565 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:17.452565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:17.452576 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:17.454420 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.455218 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.455221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.455221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.455306 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.455706 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.455708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.455708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.455853 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:17.455922 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.456541 (+ 619us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.456697 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 14:56:17.456974 17166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.443855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:42407 (local address 127.12.116.130:38325)
0620 14:56:17.444056 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.444117 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.444712 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.445066 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.445070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.445390 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:17.445964 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.445970 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.447183 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.447184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.448145 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.448149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.448768 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.448769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.448915 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.449579 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:17.449592 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:17.452408 (+ 2816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:17.454555 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:17.454568 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:17.454572 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:17.455009 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:17.455397 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:17.455398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:17.455399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:17.455579 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:17.455936 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:17.455944 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:17.456189 (+ 245us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.456388 (+ 199us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.456618 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":110,"threads_started":1}
I20260620 14:56:17.457731 17164 heartbeater.cc:347] Connected to a master server at 127.12.116.190:42407
I20260620 14:56:17.457996 17164 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:17.458278 17164 heartbeater.cc:511] Master 127.12.116.190:42407 requested a full tablet report, sending...
I20260620 14:56:17.458886 16841 ts_manager.cc:194] Registered new tserver with Master: 0a5bfaa515c647c3996639649362e109 (127.12.116.130:33339)
I20260620 14:56:17.459424 16841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:38325
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:17.485793 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:42407
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:17.587596 17169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:17.587947 17169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:17.587998 17169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:17.589561 17169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:17.589666 17169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:17.589717 17169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:17.592034 17169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:17.592556 17169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:17.592885 17169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:17.601521 17177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:17.601635 17175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.601631 17169 server_base.cc:1034] running on GCE node
W20260620 14:56:17.601521 17174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.602109 17169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:17.602420 17169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:17.603706 17169 hybrid_clock.cc:648] HybridClock initialized: now 1781967377603651 us; error 77 us; skew 500 ppm
Jun 20 14:56:17 dist-test-slave-7v06 krb5kdc[16797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:17.606945 17169 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:17.607532 17169 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:17.607620 17169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:17.607791 17169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:17.609066 17169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "ac2e791255ed49e9a8c8f7aa20af870b"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "bb62481ed23743cad077d6589488117d"
server_key_iv: "4704bb061927d662ebf50a767c8b0532"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.609477 17169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "ac2e791255ed49e9a8c8f7aa20af870b"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "bb62481ed23743cad077d6589488117d"
server_key_iv: "4704bb061927d662ebf50a767c8b0532"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.611159 17169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:56:17.612269 17183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.612725 17169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:17.613018 17169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "ac2e791255ed49e9a8c8f7aa20af870b"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "bb62481ed23743cad077d6589488117d"
server_key_iv: "4704bb061927d662ebf50a767c8b0532"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.613178 17169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:17.648999 17169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:17.653043 17169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:17.653276 17169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:17.653738 17169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:17.654260 17169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:17.654332 17169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.654381 17169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:17.654423 17169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.664228 17169 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:42869
I20260620 14:56:17.664244 17296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:42869 every 8 connection(s)
I20260620 14:56:17.664665 17169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:17.673851 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17169
I20260620 14:56:17.674099 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:17.674503 12754 external_mini_cluster.cc:1428] Setting key 91486234f81d69e0fa5dfc72bea23b57
Jun 20 14:56:17 dist-test-slave-7v06 krb5kdc[16797](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:17.679090 16880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.665920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:52903 (local address 127.12.116.190:42407)
0620 14:56:17.666034 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.666036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.666383 (+ 347us) server_negotiation.cc:407] Connection header received
0620 14:56:17.667078 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.667080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.667107 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.667188 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:17.669094 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.670133 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.672025 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.672404 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.672525 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.675472 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:17.675475 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:17.675476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:17.675487 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:17.677028 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.677527 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.677528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.677529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.677597 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.677881 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.677882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.677882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.678025 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:17.678199 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.678803 (+ 604us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.678961 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260620 14:56:17.679441 17299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.665895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:42407 (local address 127.12.116.131:52903)
0620 14:56:17.666157 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.666217 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.666905 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.667333 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.667338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.668258 (+ 920us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:17.668922 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.668930 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.670351 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.670353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.671748 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.671756 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.672706 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.672708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.672876 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.673570 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:17.673581 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:17.675343 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:17.677160 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:17.677171 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:17.677174 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:17.677443 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:17.677670 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:17.677671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:17.677671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:17.677806 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:17.678205 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:17.678221 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:17.678503 (+ 282us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.678765 (+ 262us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.679030 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":152,"threads_started":1}
I20260620 14:56:17.680612 17297 heartbeater.cc:347] Connected to a master server at 127.12.116.190:42407
I20260620 14:56:17.680763 17297 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:17.680958 17297 heartbeater.cc:511] Master 127.12.116.190:42407 requested a full tablet report, sending...
I20260620 14:56:17.681618 16841 ts_manager.cc:194] Registered new tserver with Master: ac2e791255ed49e9a8c8f7aa20af870b (127.12.116.131:42869)
I20260620 14:56:17.682145 16841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:52903
I20260620 14:56:17.687525 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:56:17.698266 16880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.689307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57286 (local address 127.12.116.190:42407)
0620 14:56:17.689480 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.689482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.689497 (+ 15us) server_negotiation.cc:407] Connection header received
0620 14:56:17.689652 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.689654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.689669 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.689744 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:17.690501 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.691143 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.692097 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.692409 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.692507 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.694075 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:17.694076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:17.694077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:17.694085 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:17.696041 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.696763 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.696764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.696765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.696854 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:17.697253 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:17.697255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:17.697255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:17.697533 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:17.697672 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.697925 (+ 253us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.698110 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260620 14:56:17.700896 16841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:17.702775 16841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:17.710173 17311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.705927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52518 (local address 127.12.116.130:33339)
0620 14:56:17.706116 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.706122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.706177 (+ 55us) server_negotiation.cc:407] Connection header received
0620 14:56:17.706329 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.706331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.706349 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.706438 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:17.706677 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.707548 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.708984 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.709704 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.709799 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.709862 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.710021 (+ 159us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.710071 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":84,"threads_started":1}
I20260620 14:56:17.710165 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.705820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:33339 (local address 127.0.0.1:52518)
0620 14:56:17.706070 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.706116 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.706204 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.706461 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.706464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.706467 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:17.706569 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.706572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.707661 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.707662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.708909 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.708912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.709800 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.709801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.709893 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.709911 (+ 18us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.709995 (+ 84us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.710064 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":53,"thread_start_us":68,"threads_started":1}
I20260620 14:56:17.710978 17308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.705880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:42103 (local address 127.0.0.1:46184)
0620 14:56:17.706316 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.706326 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.706384 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.706709 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.706709 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.706712 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:17.706758 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.706759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.707674 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.707676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.709178 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.709180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.710227 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.710228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.710761 (+ 533us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.710765 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.710845 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.710897 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":26,"thread_start_us":112,"threads_started":1}
I20260620 14:56:17.711220 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.706150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46184 (local address 127.12.116.129:42103)
0620 14:56:17.706561 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.706564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.706572 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:17.706621 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.706623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.706639 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.706713 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:17.706812 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.707559 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.709296 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.710058 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.710134 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.710186 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.710882 (+ 696us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.711139 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":85,"threads_started":1}
I20260620 14:56:17.711084 17098 tablet_service.cc:1467] Processing CreateTablet for tablet d1f84cda9bb847d59aa59d39434f861f (DEFAULT_TABLE table=test-table [id=4b2d9f577f8c4d9daa607abaad2a9938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:17.711519 17098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f84cda9bb847d59aa59d39434f861f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:17.711805 17309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.705880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:42869 (local address 127.0.0.1:54154)
0620 14:56:17.706356 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.706366 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.706406 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.708023 (+ 1617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.708024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.708026 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:17.708067 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.708069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.709386 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.709387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.710353 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.710356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.711522 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.711523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.711592 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.711596 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.711665 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.711709 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"spinlock_wait_cycles":768,"thread_start_us":110,"threads_started":1}
I20260620 14:56:17.711815 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.706138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54154 (local address 127.12.116.131:42869)
0620 14:56:17.707776 (+ 1638us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.707780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.707790 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:17.707828 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.707830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.707847 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.707925 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:17.708162 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.709283 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.710454 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.711436 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.711515 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.711568 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.711681 (+ 113us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.711726 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1594,"thread_start_us":102,"threads_started":1}
I20260620 14:56:17.711951 16965 tablet_service.cc:1467] Processing CreateTablet for tablet d1f84cda9bb847d59aa59d39434f861f (DEFAULT_TABLE table=test-table [id=4b2d9f577f8c4d9daa607abaad2a9938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:17.712366 16965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f84cda9bb847d59aa59d39434f861f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:17.712558 17231 tablet_service.cc:1467] Processing CreateTablet for tablet d1f84cda9bb847d59aa59d39434f861f (DEFAULT_TABLE table=test-table [id=4b2d9f577f8c4d9daa607abaad2a9938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:17.712908 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f84cda9bb847d59aa59d39434f861f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:17.714819 17314 tablet_bootstrap.cc:492] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Bootstrap starting.
I20260620 14:56:17.715480 17314 tablet_bootstrap.cc:654] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:17.716044 17314 log.cc:824] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:17.717178 17314 tablet_bootstrap.cc:492] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: No bootstrap required, opened a new log
I20260620 14:56:17.717281 17314 ts_tablet_manager.cc:1397] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:56:17.717911 17316 tablet_bootstrap.cc:492] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: Bootstrap starting.
I20260620 14:56:17.719050 17317 tablet_bootstrap.cc:492] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Bootstrap starting.
I20260620 14:56:17.719509 17314 raft_consensus.cc:348] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.719771 17314 raft_consensus.cc:374] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:17.719822 17314 raft_consensus.cc:729] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a5bfaa515c647c3996639649362e109, State: Initialized, Role: FOLLOWER
I20260620 14:56:17.719854 17316 tablet_bootstrap.cc:654] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:17.719949 17317 tablet_bootstrap.cc:654] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:17.719980 17314 consensus_queue.cc:260] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.720384 17164 heartbeater.cc:503] Master 127.12.116.190:42407 was elected leader, sending a full tablet report...
I20260620 14:56:17.720635 17316 log.cc:824] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:17.720635 17317 log.cc:824] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:17.720702 17314 ts_tablet_manager.cc:1428] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260620 14:56:17.721604 17316 tablet_bootstrap.cc:492] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: No bootstrap required, opened a new log
I20260620 14:56:17.721691 17316 ts_tablet_manager.cc:1397] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260620 14:56:17.721764 17317 tablet_bootstrap.cc:492] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: No bootstrap required, opened a new log
I20260620 14:56:17.721843 17317 ts_tablet_manager.cc:1397] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:56:17.724220 17317 raft_consensus.cc:348] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.724212 17316 raft_consensus.cc:348] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.724762 17317 raft_consensus.cc:374] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:17.724761 17316 raft_consensus.cc:374] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:17.724817 17317 raft_consensus.cc:729] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac2e791255ed49e9a8c8f7aa20af870b, State: Initialized, Role: FOLLOWER
I20260620 14:56:17.724817 17316 raft_consensus.cc:729] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f4d6ec3a16400c96a53864554ac14c, State: Initialized, Role: FOLLOWER
I20260620 14:56:17.725018 17316 consensus_queue.cc:260] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.725018 17317 consensus_queue.cc:260] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.725487 17317 ts_tablet_manager.cc:1428] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260620 14:56:17.725479 17316 ts_tablet_manager.cc:1428] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260620 14:56:17.725492 17031 heartbeater.cc:503] Master 127.12.116.190:42407 was elected leader, sending a full tablet report...
I20260620 14:56:17.725966 17297 heartbeater.cc:503] Master 127.12.116.190:42407 was elected leader, sending a full tablet report...
W20260620 14:56:17.750531 17032 tablet.cc:2369] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:17.791330 17321 raft_consensus.cc:482] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:17.791492 17321 raft_consensus.cc:504] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.792028 17321 leader_election.cc:288] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a5bfaa515c647c3996639649362e109 (127.12.116.130:33339), ac2e791255ed49e9a8c8f7aa20af870b (127.12.116.131:42869)
I20260620 14:56:17.796200 17311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.792403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:60831 (local address 127.12.116.130:33339)
0620 14:56:17.792471 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.792474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.792595 (+ 121us) server_negotiation.cc:407] Connection header received
0620 14:56:17.792752 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.792754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.792767 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.792902 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:17.793204 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.793819 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.795006 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.795707 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.795812 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.795870 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.796062 (+ 192us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.796122 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 14:56:17.796214 17323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.792265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:33339 (local address 127.12.116.129:60831)
0620 14:56:17.792484 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.792500 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.792645 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.792944 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.792946 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.792950 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:17.793083 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.793087 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.793944 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.793945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.794879 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.794882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.795871 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.795873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.795976 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.795981 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.796035 (+ 54us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.796089 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":132,"threads_started":1}
I20260620 14:56:17.796279 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.792610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:37353 (local address 127.12.116.131:42869)
0620 14:56:17.792662 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.792664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.792952 (+ 288us) server_negotiation.cc:407] Connection header received
0620 14:56:17.792991 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.792992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.793004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.793067 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:17.793424 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.794027 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.795266 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.795735 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.795871 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.795882 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.796143 (+ 261us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.796198 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 14:56:17.796594 17324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.792491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:42869 (local address 127.12.116.129:37353)
0620 14:56:17.792803 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.792817 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:17.792898 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:17.793157 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:17.793159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:17.793163 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:17.793284 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.793288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.794144 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.794145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.795070 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:17.795072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.795926 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.795927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:17.796046 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.796052 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:56:17.796127 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 14:56:17.796180 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":3,"thread_start_us":196,"threads_started":1}
I20260620 14:56:17.796679 17118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84cda9bb847d59aa59d39434f861f" candidate_uuid: "53f4d6ec3a16400c96a53864554ac14c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a5bfaa515c647c3996639649362e109" is_pre_election: true
I20260620 14:56:17.796875 17118 raft_consensus.cc:2454] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f4d6ec3a16400c96a53864554ac14c in term 0.
I20260620 14:56:17.797008 17251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84cda9bb847d59aa59d39434f861f" candidate_uuid: "53f4d6ec3a16400c96a53864554ac14c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" is_pre_election: true
I20260620 14:56:17.797164 17251 raft_consensus.cc:2454] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f4d6ec3a16400c96a53864554ac14c in term 0.
I20260620 14:56:17.797173 16918 leader_election.cc:302] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a5bfaa515c647c3996639649362e109, 53f4d6ec3a16400c96a53864554ac14c; no voters:
I20260620 14:56:17.797312 17321 raft_consensus.cc:2781] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:17.797375 17321 raft_consensus.cc:482] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:17.797400 17321 raft_consensus.cc:3037] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:17.798238 17321 raft_consensus.cc:504] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.798403 17321 leader_election.cc:288] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [CANDIDATE]: Term 1 election: Requested vote from peers 0a5bfaa515c647c3996639649362e109 (127.12.116.130:33339), ac2e791255ed49e9a8c8f7aa20af870b (127.12.116.131:42869)
I20260620 14:56:17.798558 17251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84cda9bb847d59aa59d39434f861f" candidate_uuid: "53f4d6ec3a16400c96a53864554ac14c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac2e791255ed49e9a8c8f7aa20af870b"
I20260620 14:56:17.798643 17251 raft_consensus.cc:3037] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:17.799499 17251 raft_consensus.cc:2454] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f4d6ec3a16400c96a53864554ac14c in term 1.
I20260620 14:56:17.799654 17118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84cda9bb847d59aa59d39434f861f" candidate_uuid: "53f4d6ec3a16400c96a53864554ac14c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a5bfaa515c647c3996639649362e109"
I20260620 14:56:17.799747 16920 leader_election.cc:302] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f4d6ec3a16400c96a53864554ac14c, ac2e791255ed49e9a8c8f7aa20af870b; no voters:
I20260620 14:56:17.799751 17118 raft_consensus.cc:3037] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:17.799856 17321 raft_consensus.cc:2781] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:17.800034 17321 raft_consensus.cc:686] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 1 LEADER]: Becoming Leader. State: Replica: 53f4d6ec3a16400c96a53864554ac14c, State: Running, Role: LEADER
I20260620 14:56:17.800161 17321 consensus_queue.cc:237] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } }
I20260620 14:56:17.800814 17118 raft_consensus.cc:2454] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f4d6ec3a16400c96a53864554ac14c in term 1.
I20260620 14:56:17.801129 16841 catalog_manager.cc:5495] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f4d6ec3a16400c96a53864554ac14c (127.12.116.129). New cstate: current_term: 1 leader_uuid: "53f4d6ec3a16400c96a53864554ac14c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53f4d6ec3a16400c96a53864554ac14c" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42103 } health_report { overall_health: HEALTHY } } }
I20260620 14:56:17.810498 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.807782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46198 (local address 127.12.116.129:42103)
0620 14:56:17.807849 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:17.807851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:17.807859 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:17.807915 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:17.807916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:17.807935 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:17.808001 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:17.808157 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.808754 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.809562 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:17.809795 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:17.809863 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:17.810072 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:17.810198 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:17.810287 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:17.810356 (+ 69us) server_negotiation.cc:299] Negotiation successful
0620 14:56:17.810377 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 14:56:17.813086 17118 raft_consensus.cc:1261] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 1 FOLLOWER]: Refusing update from remote peer 53f4d6ec3a16400c96a53864554ac14c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:17.813143 17251 raft_consensus.cc:1261] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 1 FOLLOWER]: Refusing update from remote peer 53f4d6ec3a16400c96a53864554ac14c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:17.813535 17325 consensus_queue.cc:1035] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a5bfaa515c647c3996639649362e109" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 33339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:17.813707 17321 consensus_queue.cc:1035] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac2e791255ed49e9a8c8f7aa20af870b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:17.816825 17329 mvcc.cc:205] Tried to move back new op lower bound from 7298938379518644224 to 7298938379470237696. Current Snapshot: MvccSnapshot[applied={T|T < 7298938379518644224}]
I20260620 14:56:17.817091 17328 mvcc.cc:205] Tried to move back new op lower bound from 7298938379518644224 to 7298938379470237696. Current Snapshot: MvccSnapshot[applied={T|T < 7298938379518644224 or (T in {7298938379518644224})}]
I20260620 14:56:17.818259 17330 mvcc.cc:205] Tried to move back new op lower bound from 7298938379518644224 to 7298938379470237696. Current Snapshot: MvccSnapshot[applied={T|T < 7298938379518644224}]
I20260620 14:56:17.819954 16840 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:17.820107 16840 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:17.821120 16840 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a2cc590ac90b4ba7b958c955cee6776e: Sending DeleteTablet for 3 replicas of tablet d1f84cda9bb847d59aa59d39434f861f
I20260620 14:56:17.821576 17098 tablet_service.cc:1514] Processing DeleteTablet for tablet d1f84cda9bb847d59aa59d39434f861f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:17 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:52518
I20260620 14:56:17.821610 17231 tablet_service.cc:1514] Processing DeleteTablet for tablet d1f84cda9bb847d59aa59d39434f861f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:17 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54154
I20260620 14:56:17.821897 16965 tablet_service.cc:1514] Processing DeleteTablet for tablet d1f84cda9bb847d59aa59d39434f861f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:17 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:46184
I20260620 14:56:17.822140 17339 tablet_replica.cc:330] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c: stopping tablet replica
I20260620 14:56:17.822249 17339 raft_consensus.cc:2229] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:17.822336 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16903
I20260620 14:56:17.822366 17339 raft_consensus.cc:2258] T d1f84cda9bb847d59aa59d39434f861f P 53f4d6ec3a16400c96a53864554ac14c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:17.822932 17337 tablet_replica.cc:330] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: stopping tablet replica
I20260620 14:56:17.823028 17337 raft_consensus.cc:2229] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:17.823120 17337 raft_consensus.cc:2258] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:17.823257 17338 tablet_replica.cc:330] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: stopping tablet replica
I20260620 14:56:17.823350 17338 raft_consensus.cc:2229] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:17.823426 17338 raft_consensus.cc:2258] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:17.823734 17337 ts_tablet_manager.cc:1905] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:17.823979 17338 ts_tablet_manager.cc:1905] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:17.825994 17337 ts_tablet_manager.cc:1918] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:17.826004 17338 ts_tablet_manager.cc:1918] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:17.826107 17337 log.cc:1196] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/d1f84cda9bb847d59aa59d39434f861f
I20260620 14:56:17.826105 17338 log.cc:1196] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/d1f84cda9bb847d59aa59d39434f861f
I20260620 14:56:17.826399 17337 ts_tablet_manager.cc:1939] T d1f84cda9bb847d59aa59d39434f861f P 0a5bfaa515c647c3996639649362e109: Deleting consensus metadata
I20260620 14:56:17.826411 17338 ts_tablet_manager.cc:1939] T d1f84cda9bb847d59aa59d39434f861f P ac2e791255ed49e9a8c8f7aa20af870b: Deleting consensus metadata
I20260620 14:56:17.826915 16827 catalog_manager.cc:4841] TS ac2e791255ed49e9a8c8f7aa20af870b (127.12.116.131:42869): tablet d1f84cda9bb847d59aa59d39434f861f (table test-table [id=4b2d9f577f8c4d9daa607abaad2a9938]) successfully deleted
I20260620 14:56:17.826916 16825 catalog_manager.cc:4841] TS 0a5bfaa515c647c3996639649362e109 (127.12.116.130:33339): tablet d1f84cda9bb847d59aa59d39434f861f (table test-table [id=4b2d9f577f8c4d9daa607abaad2a9938]) successfully deleted
W20260620 14:56:17.829618 16828 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:42103 (error 108)
I20260620 14:56:17.829730 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17036
I20260620 14:56:17.831840 17308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:17.831251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:42103 (local address 127.0.0.1:46210)
0620 14:56:17.831318 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:17.831517 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:42103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260620 14:56:17.833645 16828 catalog_manager.cc:4584] TS 53f4d6ec3a16400c96a53864554ac14c (127.12.116.129:42103): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d1f84cda9bb847d59aa59d39434f861f: Network error: Client connection negotiation failed: client connection to 127.12.116.129:42103: connect: Connection refused (error 111)
I20260620 14:56:17.839439 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17169
I20260620 14:56:17.845129 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 16810
2026-06-20T14:56:17Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2306 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-06-20T14:56:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:17Z Disabled control of system clock
I20260620 14:56:17.877456 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:46753
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:46753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 14:56:17.976611 17344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:17.976897 17344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:17.976924 17344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:17.978468 17344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:17.978546 17344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:17.978560 17344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:17.978575 17344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:17.978588 17344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:17.980440 17344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:46753
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:46753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:17.980835 17344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:17.981190 17344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:17.987511 17350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:17.987555 17352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.987695 17344 server_base.cc:1034] running on GCE node
W20260620 14:56:17.987555 17349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:17.988171 17344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:17.988595 17344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:17.989815 17344 hybrid_clock.cc:648] HybridClock initialized: now 1781967377989798 us; error 36 us; skew 500 ppm
I20260620 14:56:17.991504 17344 webserver.cc:460] Webserver started at http://127.12.116.190:42373/ using document root <none> and password file <none>
I20260620 14:56:17.991811 17344 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:17.992147 17344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:17.992319 17344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:17.993590 17344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "f718cb14270b4183a3e6caf38c1db630"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "676f67840af12c07a3fd5bcf336c6cad"
server_key_iv: "a6aebcd09ca7a5148390c26354174513"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.994019 17344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "f718cb14270b4183a3e6caf38c1db630"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "676f67840af12c07a3fd5bcf336c6cad"
server_key_iv: "a6aebcd09ca7a5148390c26354174513"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.995697 17344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:17.997150 17358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:17.997509 17344 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:17.997656 17344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "f718cb14270b4183a3e6caf38c1db630"
format_stamp: "Formatted at 2026-06-20 14:56:17 on dist-test-slave-7v06"
server_key: "676f67840af12c07a3fd5bcf336c6cad"
server_key_iv: "a6aebcd09ca7a5148390c26354174513"
server_key_version: "encryptionkey@0"
I20260620 14:56:17.997742 17344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:18.001716 17344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:18.002035 17344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:18.002187 17344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:18.006369 17344 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:46753
I20260620 14:56:18.006613 17410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:46753 every 8 connection(s)
I20260620 14:56:18.006858 17344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:18.007699 17411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:18.010953 17411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630: Bootstrap starting.
I20260620 14:56:18.011663 17411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:18.012013 17411 log.cc:824] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:18.012898 17411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630: No bootstrap required, opened a new log
I20260620 14:56:18.014477 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17344
I20260620 14:56:18.014633 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:18.014833 12754 external_mini_cluster.cc:1428] Setting key 4d454dae20db062d89d771e519464687
I20260620 14:56:18.014820 17411 raft_consensus.cc:348] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f718cb14270b4183a3e6caf38c1db630" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46753 } }
I20260620 14:56:18.015058 17411 raft_consensus.cc:374] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:18.015112 17411 raft_consensus.cc:729] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f718cb14270b4183a3e6caf38c1db630, State: Initialized, Role: FOLLOWER
I20260620 14:56:18.015306 17411 consensus_queue.cc:260] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f718cb14270b4183a3e6caf38c1db630" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46753 } }
I20260620 14:56:18.015408 17411 raft_consensus.cc:388] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:18.015443 17411 raft_consensus.cc:482] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:18.015499 17411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:18.016408 17411 raft_consensus.cc:504] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f718cb14270b4183a3e6caf38c1db630" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46753 } }
I20260620 14:56:18.016544 17411 leader_election.cc:302] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f718cb14270b4183a3e6caf38c1db630; no voters:
I20260620 14:56:18.016746 17411 leader_election.cc:288] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:18.016780 17416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:18.016904 17416 raft_consensus.cc:686] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [term 1 LEADER]: Becoming Leader. State: Replica: f718cb14270b4183a3e6caf38c1db630, State: Running, Role: LEADER
I20260620 14:56:18.016999 17416 consensus_queue.cc:237] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f718cb14270b4183a3e6caf38c1db630" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46753 } }
I20260620 14:56:18.017097 17411 sys_catalog.cc:564] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:18.017403 17416 sys_catalog.cc:455] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f718cb14270b4183a3e6caf38c1db630. Latest consensus state: current_term: 1 leader_uuid: "f718cb14270b4183a3e6caf38c1db630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f718cb14270b4183a3e6caf38c1db630" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46753 } } }
I20260620 14:56:18.017484 17416 sys_catalog.cc:458] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:18.017597 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.015415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50054 (local address 127.12.116.190:46753)
0620 14:56:18.015717 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.015727 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.015766 (+ 39us) server_negotiation.cc:407] Connection header received
0620 14:56:18.015887 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.015893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.015932 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.016080 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.016922 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.016927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.016927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.016932 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.016983 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.016999 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.017055 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.017298 (+ 243us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.017364 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":116,"threads_started":1}
I20260620 14:56:18.017974 17417 sys_catalog.cc:455] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f718cb14270b4183a3e6caf38c1db630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f718cb14270b4183a3e6caf38c1db630" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 46753 } } }
I20260620 14:56:18.018074 17417 sys_catalog.cc:458] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:18.018260 17420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:18.019379 17420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:18.021409 17420 catalog_manager.cc:1347] Generated new cluster ID: 1129587f6b3e41c5928fdb38f9be5e1a
I20260620 14:56:18.021488 17420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:18.033685 17420 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:18.034112 17420 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:18.045847 17420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630: Generated new TSK 0
I20260620 14:56:18.046182 17420 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:18.053296 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46753
--builtin_ntp_servers=127.12.116.148:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 14:56:18.172159 17435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:18.172780 17435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:18.172852 17435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:18.174376 17435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:18.174467 17435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:18.174515 17435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:18.178102 17435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:18.178997 17435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:18.179533 17435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:18.186305 17440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:18.186307 17441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:18.186765 17435 server_base.cc:1034] running on GCE node
W20260620 14:56:18.186345 17443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:18.187181 17435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:18.187516 17435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:18.188764 17435 hybrid_clock.cc:648] HybridClock initialized: now 1781967378188730 us; error 50 us; skew 500 ppm
I20260620 14:56:18.193149 17435 webserver.cc:460] Webserver started at http://127.12.116.129:39225/ using document root <none> and password file <none>
I20260620 14:56:18.193554 17435 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:18.194181 17435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:18.194612 17435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:18.199924 17435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "4762128f8f464b88b2bace94f975ac5d"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "2a08ea4691e910a5524e4f266dce4ca8"
server_key_iv: "e0596a82fc482e3498d7dbf96dedcbda"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.200497 17435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "4762128f8f464b88b2bace94f975ac5d"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "2a08ea4691e910a5524e4f266dce4ca8"
server_key_iv: "e0596a82fc482e3498d7dbf96dedcbda"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.202265 17435 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:18.203305 17449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.203687 17435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:18.203922 17435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "4762128f8f464b88b2bace94f975ac5d"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "2a08ea4691e910a5524e4f266dce4ca8"
server_key_iv: "e0596a82fc482e3498d7dbf96dedcbda"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.204020 17435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:18.207954 17435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:18.208315 17435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:18.208514 17435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:18.208774 17435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:18.209149 17435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:18.209208 17435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.209250 17435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:18.209280 17435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.219496 17435 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:45741
I20260620 14:56:18.219538 17562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:45741 every 8 connection(s)
I20260620 14:56:18.219980 17435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:18.220806 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17435
I20260620 14:56:18.220940 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:18.221184 12754 external_mini_cluster.cc:1428] Setting key 0022c06cbbc33a8f7864650c47e46682
I20260620 14:56:18.222397 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46753
--builtin_ntp_servers=127.12.116.148:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260620 14:56:18.224169 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.220873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:37153 (local address 127.12.116.190:46753)
0620 14:56:18.221130 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.221132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.221351 (+ 219us) server_negotiation.cc:407] Connection header received
0620 14:56:18.222084 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.222085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.222094 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.222173 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.223581 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.223582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.223583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.223590 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.223614 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.223620 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.223700 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.224058 (+ 358us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.224079 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223}
I20260620 14:56:18.224450 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.220856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:46753 (local address 127.12.116.129:37153)
0620 14:56:18.221110 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.221176 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.221918 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.222244 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.222247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.222257 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.223365 (+ 1108us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.223366 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.223402 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.223439 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.223755 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.223763 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.223766 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.224028 (+ 262us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.224122 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":93,"threads_started":1}
I20260620 14:56:18.225627 17563 heartbeater.cc:347] Connected to a master server at 127.12.116.190:46753
I20260620 14:56:18.225795 17563 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:18.225993 17563 heartbeater.cc:511] Master 127.12.116.190:46753 requested a full tablet report, sending...
I20260620 14:56:18.226595 17375 ts_manager.cc:194] Registered new tserver with Master: 4762128f8f464b88b2bace94f975ac5d (127.12.116.129:45741)
W20260620 14:56:18.320286 17566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:18.320588 17566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:18.320631 17566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:18.322095 17566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:18.322181 17566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:18.322230 17566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:18.324648 17566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:18.325026 17566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:18.325696 17566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:18.331530 17572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:18.331578 17571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:18.331534 17574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:18.331665 17566 server_base.cc:1034] running on GCE node
I20260620 14:56:18.332244 17566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:18.332621 17566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:18.333832 17566 hybrid_clock.cc:648] HybridClock initialized: now 1781967378333808 us; error 40 us; skew 500 ppm
I20260620 14:56:18.335546 17566 webserver.cc:460] Webserver started at http://127.12.116.130:38573/ using document root <none> and password file <none>
I20260620 14:56:18.335882 17566 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:18.335942 17566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:18.336078 17566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:18.337343 17566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "a6aa8c5929834ba9b7513b1229f27a8b"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "c45131624f4b18b87d225971fb5f5cba"
server_key_iv: "349fa8ba33a903d3ff00af3cc4899793"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.337752 17566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "a6aa8c5929834ba9b7513b1229f27a8b"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "c45131624f4b18b87d225971fb5f5cba"
server_key_iv: "349fa8ba33a903d3ff00af3cc4899793"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.339339 17566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:56:18.340521 17580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.340862 17566 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:18.340948 17566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "a6aa8c5929834ba9b7513b1229f27a8b"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "c45131624f4b18b87d225971fb5f5cba"
server_key_iv: "349fa8ba33a903d3ff00af3cc4899793"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.341075 17566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:18.345137 17566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:18.345443 17566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:18.345583 17566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:18.345795 17566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:18.346131 17566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:18.346164 17566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.346204 17566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:18.346231 17566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.353462 17566 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:36247
I20260620 14:56:18.353554 17693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:36247 every 8 connection(s)
I20260620 14:56:18.353915 17566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:18.357081 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.354697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:33925 (local address 127.12.116.190:46753)
0620 14:56:18.354764 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.354766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.355009 (+ 243us) server_negotiation.cc:407] Connection header received
0620 14:56:18.355466 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.355468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.355474 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.355541 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.356837 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.356838 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.356839 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.356843 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.356860 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.356864 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.356945 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.357008 (+ 63us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.357022 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 14:56:18.357295 17696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.354681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:46753 (local address 127.12.116.130:33925)
0620 14:56:18.354862 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.354905 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.355366 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.355607 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.355610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.355618 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.356655 (+ 1037us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.356655 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.356687 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.356717 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.356944 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.356946 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.356949 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.357005 (+ 56us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.357058 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260620 14:56:18.357810 17694 heartbeater.cc:347] Connected to a master server at 127.12.116.190:46753
I20260620 14:56:18.357900 17694 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:18.358021 17694 heartbeater.cc:511] Master 127.12.116.190:46753 requested a full tablet report, sending...
I20260620 14:56:18.358407 17375 ts_manager.cc:194] Registered new tserver with Master: a6aa8c5929834ba9b7513b1229f27a8b (127.12.116.130:36247)
I20260620 14:56:18.359915 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17566
I20260620 14:56:18.360003 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:18.360142 12754 external_mini_cluster.cc:1428] Setting key ee7b1b48656132925708735bd1757690
I20260620 14:56:18.361153 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46753
--builtin_ntp_servers=127.12.116.148:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 14:56:18.465430 17697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:18.465692 17697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:18.465720 17697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:18.467147 17697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:18.467227 17697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:18.467259 17697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:18.469352 17697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:46753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:18.469631 17697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:18.469933 17697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:18.476652 17703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:18.476684 17702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:18.476663 17705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:18.477156 17697 server_base.cc:1034] running on GCE node
I20260620 14:56:18.477442 17697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:18.477767 17697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:18.478986 17697 hybrid_clock.cc:648] HybridClock initialized: now 1781967378478965 us; error 48 us; skew 500 ppm
I20260620 14:56:18.480903 17697 webserver.cc:460] Webserver started at http://127.12.116.131:34061/ using document root <none> and password file <none>
I20260620 14:56:18.481199 17697 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:18.481277 17697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:18.481441 17697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:18.482666 17697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "1eaa7a9cd9214a6dbf6831882c88016f"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "ed5abf7726a906fb3ff4f5d775a7a2e6"
server_key_iv: "7586a946af0e176ff828f3f85cf2d00a"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.483132 17697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "1eaa7a9cd9214a6dbf6831882c88016f"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "ed5abf7726a906fb3ff4f5d775a7a2e6"
server_key_iv: "7586a946af0e176ff828f3f85cf2d00a"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.484884 17697 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 14:56:18.486024 17711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.486297 17697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:18.486423 17697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "1eaa7a9cd9214a6dbf6831882c88016f"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "ed5abf7726a906fb3ff4f5d775a7a2e6"
server_key_iv: "7586a946af0e176ff828f3f85cf2d00a"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.486524 17697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:18.490758 17697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:18.491178 17697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:18.491340 17697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:18.491585 17697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:18.491953 17697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:18.492008 17697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.492053 17697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:18.492079 17697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.501065 17697 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:36741
I20260620 14:56:18.501120 17824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:36741 every 8 connection(s)
I20260620 14:56:18.501542 17697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:18.505314 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.502401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:45123 (local address 127.12.116.190:46753)
0620 14:56:18.502457 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.502460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.502874 (+ 414us) server_negotiation.cc:407] Connection header received
0620 14:56:18.503395 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.503396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.503402 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.503467 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.505050 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.505051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.505052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.505057 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.505077 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.505082 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.505146 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.505233 (+ 87us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.505249 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:56:18.505489 17827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.502415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:46753 (local address 127.12.116.131:45123)
0620 14:56:18.502696 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.502745 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.503296 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.503527 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.503531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.503540 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.504821 (+ 1281us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.504822 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.504859 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.504905 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.505155 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.505161 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.505164 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.505234 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.505300 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":115,"threads_started":1}
I20260620 14:56:18.506171 17825 heartbeater.cc:347] Connected to a master server at 127.12.116.190:46753
I20260620 14:56:18.506295 17825 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:18.506443 17825 heartbeater.cc:511] Master 127.12.116.190:46753 requested a full tablet report, sending...
I20260620 14:56:18.506909 17375 ts_manager.cc:194] Registered new tserver with Master: 1eaa7a9cd9214a6dbf6831882c88016f (127.12.116.131:36741)
I20260620 14:56:18.507282 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17697
I20260620 14:56:18.507400 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:18.507776 12754 external_mini_cluster.cc:1428] Setting key c770955d0c832cd115dedffd5f8d88cc
I20260620 14:56:18.508700 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:56:18.511632 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.510197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.12.116.190:46753)
0620 14:56:18.510269 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.510271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.510413 (+ 142us) server_negotiation.cc:407] Connection header received
0620 14:56:18.510487 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.510488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.510493 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.510545 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.511277 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.511278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.511278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.511283 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.511302 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.511306 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.511380 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.511491 (+ 111us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.511506 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260620 14:56:18.514073 17375 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:18.516558 17375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:18.521935 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.519378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:36247 (local address 127.0.0.1:45166)
0620 14:56:18.520200 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.520249 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.520356 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.520589 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.520596 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.520604 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.521421 (+ 817us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.521421 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.521442 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.521474 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.521732 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.521739 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.521743 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.521819 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.521835 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":65,"threads_started":1}
I20260620 14:56:18.522303 17834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.519383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:36741 (local address 127.0.0.1:43452)
0620 14:56:18.520596 (+ 1213us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.520605 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.520658 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.520914 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.520915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.520918 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.521784 (+ 866us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.521785 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.521792 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.521808 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.522188 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.522189 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.522190 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.522233 (+ 43us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.522245 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1203,"thread_start_us":71,"threads_started":1}
I20260620 14:56:18.522294 17836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.519553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45166 (local address 127.12.116.130:36247)
0620 14:56:18.519793 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.519800 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.520355 (+ 555us) server_negotiation.cc:407] Connection header received
0620 14:56:18.520427 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.520431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.520444 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.520543 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.521577 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.521586 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.521586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.521591 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.521630 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.521657 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.521735 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.522182 (+ 447us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.522202 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":141,"threads_started":1}
I20260620 14:56:18.522457 17833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.519378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:45741 (local address 127.0.0.1:55488)
0620 14:56:18.520465 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.520477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.520527 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.521374 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.521376 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.521378 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.521853 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.521853 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.521859 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.521870 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.522285 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.522286 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.522287 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.522324 (+ 37us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.522336 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260620 14:56:18.522658 17837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.519754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.12.116.131:36741)
0620 14:56:18.520127 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.520134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.520734 (+ 600us) server_negotiation.cc:407] Connection header received
0620 14:56:18.520773 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.520775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.520788 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.520905 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.522006 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.522015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.522016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.522022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.522068 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.522098 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.522159 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.522541 (+ 382us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.522560 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":158,"threads_started":1}
I20260620 14:56:18.522789 17838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.519916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55488 (local address 127.12.116.129:45741)
0620 14:56:18.520145 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.520150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.520982 (+ 832us) server_negotiation.cc:407] Connection header received
0620 14:56:18.521020 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.521023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.521036 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.521117 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.521946 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.521954 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.521954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.521959 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.521995 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.522022 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.522633 (+ 611us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.522663 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.522681 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":115,"threads_started":1}
I20260620 14:56:18.523070 17628 tablet_service.cc:1467] Processing CreateTablet for tablet dd5e3389d86840d5b13ee710238bc9a7 (DEFAULT_TABLE table=test-table [id=ed5222cf8ffc46d1b7322dec9f7acd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:18.523416 17758 tablet_service.cc:1467] Processing CreateTablet for tablet dd5e3389d86840d5b13ee710238bc9a7 (DEFAULT_TABLE table=test-table [id=ed5222cf8ffc46d1b7322dec9f7acd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:18.523512 17628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd5e3389d86840d5b13ee710238bc9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:18.523422 17496 tablet_service.cc:1467] Processing CreateTablet for tablet dd5e3389d86840d5b13ee710238bc9a7 (DEFAULT_TABLE table=test-table [id=ed5222cf8ffc46d1b7322dec9f7acd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:18.523748 17496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd5e3389d86840d5b13ee710238bc9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:18.523767 17758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd5e3389d86840d5b13ee710238bc9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:18.526650 17839 tablet_bootstrap.cc:492] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Bootstrap starting.
I20260620 14:56:18.527155 17841 tablet_bootstrap.cc:492] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Bootstrap starting.
I20260620 14:56:18.527570 17840 tablet_bootstrap.cc:492] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: Bootstrap starting.
I20260620 14:56:18.527618 17839 tablet_bootstrap.cc:654] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:18.528086 17839 log.cc:824] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:18.528460 17840 tablet_bootstrap.cc:654] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:18.528753 17840 log.cc:824] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:18.529089 17841 tablet_bootstrap.cc:654] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:18.529111 17839 tablet_bootstrap.cc:492] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: No bootstrap required, opened a new log
I20260620 14:56:18.529192 17839 ts_tablet_manager.cc:1397] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260620 14:56:18.529425 17841 log.cc:824] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:18.529799 17840 tablet_bootstrap.cc:492] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: No bootstrap required, opened a new log
I20260620 14:56:18.529911 17840 ts_tablet_manager.cc:1397] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 14:56:18.532639 17840 raft_consensus.cc:348] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.532650 17839 raft_consensus.cc:348] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.532864 17840 raft_consensus.cc:374] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:18.532894 17840 raft_consensus.cc:729] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4762128f8f464b88b2bace94f975ac5d, State: Initialized, Role: FOLLOWER
I20260620 14:56:18.532886 17839 raft_consensus.cc:374] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:18.532932 17839 raft_consensus.cc:729] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eaa7a9cd9214a6dbf6831882c88016f, State: Initialized, Role: FOLLOWER
I20260620 14:56:18.533107 17839 consensus_queue.cc:260] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.533159 17840 consensus_queue.cc:260] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.533562 17839 ts_tablet_manager.cc:1428] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Time spent starting tablet: real 0.004s user 0.003s sys 0.002s
I20260620 14:56:18.533708 17825 heartbeater.cc:503] Master 127.12.116.190:46753 was elected leader, sending a full tablet report...
I20260620 14:56:18.533911 17563 heartbeater.cc:503] Master 127.12.116.190:46753 was elected leader, sending a full tablet report...
I20260620 14:56:18.534235 17840 ts_tablet_manager.cc:1428] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260620 14:56:18.535295 17841 tablet_bootstrap.cc:492] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: No bootstrap required, opened a new log
I20260620 14:56:18.535562 17841 ts_tablet_manager.cc:1397] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260620 14:56:18.538471 17841 raft_consensus.cc:348] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.538705 17841 raft_consensus.cc:374] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:18.538769 17841 raft_consensus.cc:729] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6aa8c5929834ba9b7513b1229f27a8b, State: Initialized, Role: FOLLOWER
I20260620 14:56:18.538964 17841 consensus_queue.cc:260] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.539317 17841 ts_tablet_manager.cc:1428] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260620 14:56:18.539399 17694 heartbeater.cc:503] Master 127.12.116.190:46753 was elected leader, sending a full tablet report...
W20260620 14:56:18.604550 17695 tablet.cc:2369] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:18.638975 17846 raft_consensus.cc:482] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:18.639411 17846 raft_consensus.cc:504] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.640023 17846 leader_election.cc:288] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eaa7a9cd9214a6dbf6831882c88016f (127.12.116.131:36741), a6aa8c5929834ba9b7513b1229f27a8b (127.12.116.130:36247)
I20260620 14:56:18.641700 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.640305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:36247 (local address 127.12.116.129:33473)
0620 14:56:18.640459 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.640472 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.640526 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.640689 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.640690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.640693 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.641193 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.641193 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.641202 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.641217 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.641513 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.641513 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.641514 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.641606 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.641624 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260620 14:56:18.641752 17837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.640487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:41215 (local address 127.12.116.131:36741)
0620 14:56:18.640540 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.640542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.640624 (+ 82us) server_negotiation.cc:407] Connection header received
0620 14:56:18.640701 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.640702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.640708 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.640781 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.641501 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.641503 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.641503 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.641508 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.641532 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.641538 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.641594 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.641679 (+ 85us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.641692 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:56:18.641739 17836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.640453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:33473 (local address 127.12.116.130:36247)
0620 14:56:18.640501 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.640503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.640515 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:18.640597 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.640598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.640605 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.640669 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.641335 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.641338 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.641338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.641344 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.641366 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.641371 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.641479 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.641648 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.641665 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:56:18.641960 17848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.640306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:36741 (local address 127.12.116.129:41215)
0620 14:56:18.640547 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.640558 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.640636 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.640800 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.640801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.640803 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:18.641388 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:18.641388 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:18.641396 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:18.641409 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:18.641604 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:18.641605 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:18.641606 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 14:56:18.641851 (+ 245us) client_negotiation.cc:240] Negotiation successful
0620 14:56:18.641868 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":16,"thread_start_us":114,"threads_started":1}
I20260620 14:56:18.642234 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5e3389d86840d5b13ee710238bc9a7" candidate_uuid: "4762128f8f464b88b2bace94f975ac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" is_pre_election: true
I20260620 14:56:18.642295 17779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5e3389d86840d5b13ee710238bc9a7" candidate_uuid: "4762128f8f464b88b2bace94f975ac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" is_pre_election: true
I20260620 14:56:18.642436 17648 raft_consensus.cc:2454] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4762128f8f464b88b2bace94f975ac5d in term 0.
I20260620 14:56:18.642472 17779 raft_consensus.cc:2454] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4762128f8f464b88b2bace94f975ac5d in term 0.
I20260620 14:56:18.642704 17451 leader_election.cc:302] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eaa7a9cd9214a6dbf6831882c88016f, 4762128f8f464b88b2bace94f975ac5d; no voters:
I20260620 14:56:18.642855 17846 raft_consensus.cc:2781] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:18.642920 17846 raft_consensus.cc:482] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:18.642938 17846 raft_consensus.cc:3037] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:18.643779 17846 raft_consensus.cc:504] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.643947 17846 leader_election.cc:288] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [CANDIDATE]: Term 1 election: Requested vote from peers 1eaa7a9cd9214a6dbf6831882c88016f (127.12.116.131:36741), a6aa8c5929834ba9b7513b1229f27a8b (127.12.116.130:36247)
I20260620 14:56:18.644272 17779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5e3389d86840d5b13ee710238bc9a7" candidate_uuid: "4762128f8f464b88b2bace94f975ac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eaa7a9cd9214a6dbf6831882c88016f"
I20260620 14:56:18.644399 17779 raft_consensus.cc:3037] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:18.645176 17779 raft_consensus.cc:2454] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4762128f8f464b88b2bace94f975ac5d in term 1.
I20260620 14:56:18.645290 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5e3389d86840d5b13ee710238bc9a7" candidate_uuid: "4762128f8f464b88b2bace94f975ac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6aa8c5929834ba9b7513b1229f27a8b"
I20260620 14:56:18.645402 17451 leader_election.cc:302] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eaa7a9cd9214a6dbf6831882c88016f, 4762128f8f464b88b2bace94f975ac5d; no voters:
I20260620 14:56:18.645398 17648 raft_consensus.cc:3037] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:18.645507 17846 raft_consensus.cc:2781] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:18.645733 17846 raft_consensus.cc:686] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 1 LEADER]: Becoming Leader. State: Replica: 4762128f8f464b88b2bace94f975ac5d, State: Running, Role: LEADER
I20260620 14:56:18.645972 17846 consensus_queue.cc:237] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } }
I20260620 14:56:18.646302 17648 raft_consensus.cc:2454] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4762128f8f464b88b2bace94f975ac5d in term 1.
I20260620 14:56:18.647425 17373 catalog_manager.cc:5495] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4762128f8f464b88b2bace94f975ac5d (127.12.116.129). New cstate: current_term: 1 leader_uuid: "4762128f8f464b88b2bace94f975ac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4762128f8f464b88b2bace94f975ac5d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:18.675566 17838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.674110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.12.116.129:45741)
0620 14:56:18.674166 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.674168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.674177 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:18.674267 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.674268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.674284 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.674337 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.675066 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.675067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.675068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.675072 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.675090 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.675096 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.675316 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.675373 (+ 57us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.675400 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 14:56:18.678376 17648 raft_consensus.cc:1261] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 1 FOLLOWER]: Refusing update from remote peer 4762128f8f464b88b2bace94f975ac5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:18.678401 17779 raft_consensus.cc:1261] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 1 FOLLOWER]: Refusing update from remote peer 4762128f8f464b88b2bace94f975ac5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:18.678877 17849 consensus_queue.cc:1035] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6aa8c5929834ba9b7513b1229f27a8b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:18.679049 17846 consensus_queue.cc:1035] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eaa7a9cd9214a6dbf6831882c88016f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:18.682561 17854 mvcc.cc:205] Tried to move back new op lower bound from 7298938383062507520 to 7298938382934499328. Current Snapshot: MvccSnapshot[applied={T|T < 7298938383062507520}]
I20260620 14:56:18.685369 17374 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:18.685503 17374 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:18.686540 17374 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f718cb14270b4183a3e6caf38c1db630: Sending DeleteTablet for 3 replicas of tablet dd5e3389d86840d5b13ee710238bc9a7
I20260620 14:56:18.687006 17496 tablet_service.cc:1514] Processing DeleteTablet for tablet dd5e3389d86840d5b13ee710238bc9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:18 UTC) from {username='slave'} at 127.0.0.1:55488
I20260620 14:56:18.687018 17628 tablet_service.cc:1514] Processing DeleteTablet for tablet dd5e3389d86840d5b13ee710238bc9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:18 UTC) from {username='slave'} at 127.0.0.1:45166
I20260620 14:56:18.687021 17758 tablet_service.cc:1514] Processing DeleteTablet for tablet dd5e3389d86840d5b13ee710238bc9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:18 UTC) from {username='slave'} at 127.0.0.1:43452
I20260620 14:56:18.687337 17863 tablet_replica.cc:330] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d: stopping tablet replica
I20260620 14:56:18.687451 17863 raft_consensus.cc:2229] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:18.687740 17863 raft_consensus.cc:2258] T dd5e3389d86840d5b13ee710238bc9a7 P 4762128f8f464b88b2bace94f975ac5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:18.687990 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17435
I20260620 14:56:18.688155 17864 tablet_replica.cc:330] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: stopping tablet replica
I20260620 14:56:18.688786 17864 raft_consensus.cc:2229] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:18.688939 17864 raft_consensus.cc:2258] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:18.689970 17864 ts_tablet_manager.cc:1905] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:18.690579 17862 tablet_replica.cc:330] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: stopping tablet replica
I20260620 14:56:18.690764 17862 raft_consensus.cc:2229] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:18.691323 17862 raft_consensus.cc:2258] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:18.692050 17862 ts_tablet_manager.cc:1905] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:18.693214 17864 ts_tablet_manager.cc:1918] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:18.693331 17864 log.cc:1196] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/dd5e3389d86840d5b13ee710238bc9a7
I20260620 14:56:18.693674 17864 ts_tablet_manager.cc:1939] T dd5e3389d86840d5b13ee710238bc9a7 P a6aa8c5929834ba9b7513b1229f27a8b: Deleting consensus metadata
I20260620 14:56:18.693694 17862 ts_tablet_manager.cc:1918] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:18.693789 17862 log.cc:1196] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/dd5e3389d86840d5b13ee710238bc9a7
I20260620 14:56:18.694031 17862 ts_tablet_manager.cc:1939] T dd5e3389d86840d5b13ee710238bc9a7 P 1eaa7a9cd9214a6dbf6831882c88016f: Deleting consensus metadata
I20260620 14:56:18.694319 17361 catalog_manager.cc:4841] TS a6aa8c5929834ba9b7513b1229f27a8b (127.12.116.130:36247): tablet dd5e3389d86840d5b13ee710238bc9a7 (table test-table [id=ed5222cf8ffc46d1b7322dec9f7acd89]) successfully deleted
I20260620 14:56:18.694483 17360 catalog_manager.cc:4841] TS 1eaa7a9cd9214a6dbf6831882c88016f (127.12.116.131:36741): tablet dd5e3389d86840d5b13ee710238bc9a7 (table test-table [id=ed5222cf8ffc46d1b7322dec9f7acd89]) successfully deleted
W20260620 14:56:18.695895 17362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:45741 (error 108)
I20260620 14:56:18.696027 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17566
I20260620 14:56:18.697484 17833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.697305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:45741 (local address 127.0.0.1:55506)
0620 14:56:18.697389 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.697450 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:45741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260620 14:56:18.700614 17362 catalog_manager.cc:4584] TS 4762128f8f464b88b2bace94f975ac5d (127.12.116.129:45741): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd5e3389d86840d5b13ee710238bc9a7: Network error: Client connection negotiation failed: client connection to 127.12.116.129:45741: connect: Connection refused (error 111)
I20260620 14:56:18.702078 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17697
I20260620 14:56:18.707872 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17344
2026-06-20T14:56:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (861 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260620 14:56:18.729604 12754 mini_oidc.cc:152] Starting JWKS server
I20260620 14:56:18.730786 12754 webserver.cc:460] Webserver started at https://127.0.0.1:38361/ using document root <none> and password file <none>
I20260620 14:56:18.730939 12754 mini_oidc.cc:189] Starting OIDC Discovery server
I20260620 14:56:18.731148 12754 webserver.cc:460] Webserver started at http://127.0.0.1:43231/ using document root <none> and password file <none>
2026-06-20T14:56:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:18Z Disabled control of system clock
I20260620 14:56:18.742416 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:44047
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:36481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:44047
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38361/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/testchainca.cert with env {}
W20260620 14:56:18.850049 17871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:18.850343 17871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:18.850371 17871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:18.851912 17871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:18.851995 17871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:18.852010 17871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:18.852023 17871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:18.852036 17871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 14:56:18.852049 17871 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 14:56:18.852061 17871 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38361/jwks.json
I20260620 14:56:18.854354 17871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:44047
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:44047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38361/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:18.854692 17871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:18.855003 17871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:18.861723 17879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:18.861927 17876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:18.861991 17871 server_base.cc:1034] running on GCE node
W20260620 14:56:18.861805 17877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:18.862514 17871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:18.862885 17871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:18.864168 17871 hybrid_clock.cc:648] HybridClock initialized: now 1781967378864136 us; error 41 us; skew 500 ppm
I20260620 14:56:18.866398 17871 webserver.cc:460] Webserver started at http://127.12.116.190:41981/ using document root <none> and password file <none>
I20260620 14:56:18.866792 17871 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:18.866886 17871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:18.867434 17871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:18.869168 17871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "8d6e5e7fb4f74919a3b996c86763dfe0"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "84156309436229f9e25a9885112c520e"
server_key_iv: "5e85321ef80531904111d93a6b4c94b4"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.869891 17871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "8d6e5e7fb4f74919a3b996c86763dfe0"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "84156309436229f9e25a9885112c520e"
server_key_iv: "5e85321ef80531904111d93a6b4c94b4"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.871591 17871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:56:18.872558 17885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:18.872822 17871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:18.872936 17871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "8d6e5e7fb4f74919a3b996c86763dfe0"
format_stamp: "Formatted at 2026-06-20 14:56:18 on dist-test-slave-7v06"
server_key: "84156309436229f9e25a9885112c520e"
server_key_iv: "5e85321ef80531904111d93a6b4c94b4"
server_key_version: "encryptionkey@0"
I20260620 14:56:18.873021 17871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:18.890219 17871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:18.890726 17871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:18.890926 17871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:18.896632 17871 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:44047
I20260620 14:56:18.896838 17937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:44047 every 8 connection(s)
I20260620 14:56:18.897141 17871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:18.898931 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17871
I20260620 14:56:18.899271 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:18.899351 17938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:18.899619 12754 external_mini_cluster.cc:1428] Setting key ae3f4923694803d3c870b2af3b067824
I20260620 14:56:18.903682 17938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0: Bootstrap starting.
I20260620 14:56:18.904608 17938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:18.905009 17938 log.cc:824] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:18.905913 17938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0: No bootstrap required, opened a new log
I20260620 14:56:18.906239 17941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.900629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48466 (local address 127.12.116.190:44047)
0620 14:56:18.900928 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.900938 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.900968 (+ 30us) server_negotiation.cc:407] Connection header received
0620 14:56:18.901451 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.901459 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.901534 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.901726 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:18.901989 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:18.902945 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:18.903797 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:18.904426 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:18.904584 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:18.905475 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:18.905480 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:18.905480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:18.905686 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:18.905727 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:18.905740 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:18.905816 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:18.905901 (+ 85us) server_negotiation.cc:299] Negotiation successful
0620 14:56:18.905998 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":120,"threads_started":1}
I20260620 14:56:18.908058 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:56:18.908641 17938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44047 } }
I20260620 14:56:18.908842 17938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:18.908890 17938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d6e5e7fb4f74919a3b996c86763dfe0, State: Initialized, Role: FOLLOWER
I20260620 14:56:18.909034 17938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44047 } }
I20260620 14:56:18.909132 17938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:18.909178 17938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:18.909233 17938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:18.910166 17938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44047 } }
I20260620 14:56:18.910301 17938 leader_election.cc:302] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d6e5e7fb4f74919a3b996c86763dfe0; no voters:
I20260620 14:56:18.910513 17938 leader_election.cc:288] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:18.910720 17944 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:18.910846 17938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:18.910880 17944 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [term 1 LEADER]: Becoming Leader. State: Replica: 8d6e5e7fb4f74919a3b996c86763dfe0, State: Running, Role: LEADER
I20260620 14:56:18.910964 17944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44047 } }
I20260620 14:56:18.911610 17945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d6e5e7fb4f74919a3b996c86763dfe0. Latest consensus state: current_term: 1 leader_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44047 } } }
I20260620 14:56:18.911724 17945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:18.911955 17952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:18.912108 17943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6e5e7fb4f74919a3b996c86763dfe0" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44047 } } }
I20260620 14:56:18.912191 17943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:18.912660 17952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:18.914867 17952 catalog_manager.cc:1347] Generated new cluster ID: ccce04caf39a45929c52b0449c056e34
I20260620 14:56:18.914964 17952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:18.927378 17952 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:18.928149 17952 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:18.942441 17952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d6e5e7fb4f74919a3b996c86763dfe0: Generated new TSK 0
I20260620 14:56:18.942693 17952 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260620 14:56:18.979628 17968 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260620 14:56:18.979784 17968 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260620 14:56:18.980078 17941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:18.961725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48476 (local address 127.12.116.190:44047)
0620 14:56:18.961823 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:18.961825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:18.962009 (+ 184us) server_negotiation.cc:407] Connection header received
0620 14:56:18.962106 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:18.962107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:18.962120 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:18.962178 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0620 14:56:18.962356 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:18.962875 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:18.964158 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:18.964459 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:18.964530 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:18.964850 (+ 320us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 14:56:18.979802 (+ 14952us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0620 14:56:18.980004 (+ 202us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48476: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":54}
W20260620 14:56:18.980150 17941 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48476: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260620 14:56:18.980605 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:18.961660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:44047 (local address 127.0.0.1:48476)
0620 14:56:18.961888 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:18.961901 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:18.961993 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:18.962205 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:18.962206 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:18.962208 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0620 14:56:18.962281 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:18.962284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:18.962990 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:18.962991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:18.963997 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:18.964002 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:18.964557 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:18.964558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:18.964623 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:18.964661 (+ 38us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 14:56:18.980022 (+ 15361us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0620 14:56:18.980137 (+ 115us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.116.190:44047: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":118,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.116.190:44047: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260620 14:56:18.981079 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17871
2026-06-20T14:56:19Z chronyd exiting
I20260620 14:56:19.019369 12754 test_util.cc:175] -----------------------------------------------
I20260620 14:56:19.019481 12754 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781967351633327-12754-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (291 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260620 14:56:19.020421 12754 mini_oidc.cc:152] Starting JWKS server
I20260620 14:56:19.021406 12754 webserver.cc:460] Webserver started at https://127.0.0.1:43695/ using document root <none> and password file <none>
I20260620 14:56:19.021476 12754 mini_oidc.cc:189] Starting OIDC Discovery server
I20260620 14:56:19.021680 12754 webserver.cc:460] Webserver started at http://127.0.0.1:34043/ using document root <none> and password file <none>
2026-06-20T14:56:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:19Z Disabled control of system clock
I20260620 14:56:19.030983 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:42919
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:45169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:42919
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43695/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/testchainca.cert with env {}
W20260620 14:56:19.140132 17974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:19.140517 17974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:19.140573 17974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:19.142429 17974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:19.142524 17974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:19.142545 17974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:19.142567 17974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:19.142597 17974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 14:56:19.142628 17974 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 14:56:19.142652 17974 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43695/jwks.json
I20260620 14:56:19.144706 17974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:42919
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:42919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43695/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:19.145068 17974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:19.145325 17974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:19.152195 17982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:19.152233 17979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:19.152458 17974 server_base.cc:1034] running on GCE node
W20260620 14:56:19.152586 17980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:19.153574 17974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:19.154397 17974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:19.155791 17974 hybrid_clock.cc:648] HybridClock initialized: now 1781967379155750 us; error 74 us; skew 500 ppm
I20260620 14:56:19.158064 17974 webserver.cc:460] Webserver started at http://127.12.116.190:45487/ using document root <none> and password file <none>
I20260620 14:56:19.158345 17974 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:19.158397 17974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:19.158505 17974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:19.159768 17974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "e4d4dbce271847bf8dfb4c1cb58dc120"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "187307ac4dfa01d72d806955cdd5039a"
server_key_iv: "2ec079035a17863685fa0512dbc0a470"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.160313 17974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "e4d4dbce271847bf8dfb4c1cb58dc120"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "187307ac4dfa01d72d806955cdd5039a"
server_key_iv: "2ec079035a17863685fa0512dbc0a470"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.162544 17974 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:19.163772 17988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:19.164248 17974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:19.164418 17974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "e4d4dbce271847bf8dfb4c1cb58dc120"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "187307ac4dfa01d72d806955cdd5039a"
server_key_iv: "2ec079035a17863685fa0512dbc0a470"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.164515 17974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:19.177348 17974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:19.177685 17974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:19.177839 17974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:19.182860 17974 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:42919
I20260620 14:56:19.182900 18040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:42919 every 8 connection(s)
I20260620 14:56:19.183264 17974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:19.184002 18041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:19.187013 18041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120: Bootstrap starting.
I20260620 14:56:19.187709 18041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:19.188019 18041 log.cc:824] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:19.188192 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 17974
I20260620 14:56:19.188352 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:19.188565 12754 external_mini_cluster.cc:1428] Setting key 32592d8667d02bfd07aa437fe7ff29b0
I20260620 14:56:19.189108 18041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120: No bootstrap required, opened a new log
I20260620 14:56:19.192099 18041 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42919 } }
I20260620 14:56:19.192314 18041 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:19.192380 18041 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d4dbce271847bf8dfb4c1cb58dc120, State: Initialized, Role: FOLLOWER
I20260620 14:56:19.192514 18041 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42919 } }
I20260620 14:56:19.192595 18041 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:19.192631 18041 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:19.192691 18041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:19.193410 18041 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42919 } }
I20260620 14:56:19.193557 18041 leader_election.cc:302] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4d4dbce271847bf8dfb4c1cb58dc120; no voters:
I20260620 14:56:19.193733 18041 leader_election.cc:288] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:19.193820 18046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:19.193998 18046 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [term 1 LEADER]: Becoming Leader. State: Replica: e4d4dbce271847bf8dfb4c1cb58dc120, State: Running, Role: LEADER
I20260620 14:56:19.194011 18041 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:19.194103 18046 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42919 } }
I20260620 14:56:19.194500 18047 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42919 } } }
I20260620 14:56:19.194589 18047 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:19.194826 18048 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4d4dbce271847bf8dfb4c1cb58dc120. Latest consensus state: current_term: 1 leader_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d4dbce271847bf8dfb4c1cb58dc120" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 42919 } } }
I20260620 14:56:19.194947 18048 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:19.195623 18054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:19.196221 18054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:19.196265 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:19.189223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48484 (local address 127.12.116.190:42919)
0620 14:56:19.189498 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:19.189507 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:19.189540 (+ 33us) server_negotiation.cc:407] Connection header received
0620 14:56:19.190540 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:19.190551 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:19.190643 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:19.190817 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:19.191056 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.192552 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.193500 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.194195 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.194743 (+ 548us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.195139 (+ 396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:19.195144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:19.195144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:19.195397 (+ 253us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:19.195442 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:19.195459 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:19.195527 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:19.195962 (+ 435us) server_negotiation.cc:299] Negotiation successful
0620 14:56:19.196055 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":116,"threads_started":1}
I20260620 14:56:19.197317 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:56:19.198102 18054 catalog_manager.cc:1347] Generated new cluster ID: a94d60f20d8c41ae95a624a12551085c
I20260620 14:56:19.198156 18054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:19.220001 18054 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:19.220825 18054 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:19.224542 18054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4d4dbce271847bf8dfb4c1cb58dc120: Generated new TSK 0
I20260620 14:56:19.224828 18054 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260620 14:56:19.247448 18071 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260620 14:56:19.247552 18071 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260620 14:56:19.247951 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:19.233052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48492 (local address 127.12.116.190:42919)
0620 14:56:19.233127 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:19.233129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:19.233189 (+ 60us) server_negotiation.cc:407] Connection header received
0620 14:56:19.233286 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:19.233287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:19.233305 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:19.233394 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0620 14:56:19.233549 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.234166 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.235021 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.235267 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.235351 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.235564 (+ 213us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 14:56:19.247687 (+ 12123us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43695/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0620 14:56:19.247869 (+ 182us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48492: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43695/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":50}
W20260620 14:56:19.248014 18045 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48492: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43695/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260620 14:56:19.248025 18070 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:19.232943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:42919 (local address 127.0.0.1:48492)
0620 14:56:19.233113 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:19.233126 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:19.233213 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:19.233391 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:19.233392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:19.233395 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0620 14:56:19.233462 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:19.233464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.234268 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.234269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:19.234919 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:19.234921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.235354 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.235356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:19.235420 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.235428 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 14:56:19.247816 (+ 12388us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43695/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0620 14:56:19.247924 (+ 108us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.116.190:42919: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43695/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260620 14:56:19.248392 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 17974
2026-06-20T14:56:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (266 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260620 14:56:19.287087 12754 mini_oidc.cc:152] Starting JWKS server
I20260620 14:56:19.287860 12754 webserver.cc:460] Webserver started at https://127.0.0.1:39573/ using document root <none> and password file <none>
I20260620 14:56:19.287938 12754 mini_oidc.cc:189] Starting OIDC Discovery server
I20260620 14:56:19.288120 12754 webserver.cc:460] Webserver started at http://127.0.0.1:34713/ using document root <none> and password file <none>
2026-06-20T14:56:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:19Z Disabled control of system clock
I20260620 14:56:19.297641 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36603
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36603
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39573/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260620 14:56:19.393182 18077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:19.393456 18077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:19.393483 18077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:19.394826 18077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:19.394879 18077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:19.394893 18077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:19.394905 18077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:19.394918 18077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 14:56:19.394932 18077 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 14:56:19.394942 18077 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39573/jwks.json
I20260620 14:56:19.396523 18077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39573/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:19.396773 18077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:19.397272 18077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:19.404137 18085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:19.404255 18082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:19.404417 18077 server_base.cc:1034] running on GCE node
W20260620 14:56:19.404459 18083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:19.404747 18077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:19.405098 18077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:19.406299 18077 hybrid_clock.cc:648] HybridClock initialized: now 1781967379406263 us; error 54 us; skew 500 ppm
I20260620 14:56:19.408003 18077 webserver.cc:460] Webserver started at http://127.12.116.190:43585/ using document root <none> and password file <none>
I20260620 14:56:19.408298 18077 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:19.408422 18077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:19.408584 18077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:19.410122 18077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "0c6a0917907342b9a560a9b8a0dc6a44"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "42c6fd3db3e9f8af3c09628c9103f4d5"
server_key_iv: "4eedcc5d84e35b73d5ad9d589498eb1e"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.410609 18077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "0c6a0917907342b9a560a9b8a0dc6a44"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "42c6fd3db3e9f8af3c09628c9103f4d5"
server_key_iv: "4eedcc5d84e35b73d5ad9d589498eb1e"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.412236 18077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:19.413549 18091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:19.413921 18077 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:19.414227 18077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "0c6a0917907342b9a560a9b8a0dc6a44"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "42c6fd3db3e9f8af3c09628c9103f4d5"
server_key_iv: "4eedcc5d84e35b73d5ad9d589498eb1e"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.414392 18077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:19.437963 18077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:19.438419 18077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:19.438556 18077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:19.444665 18077 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:36603
I20260620 14:56:19.444758 18143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:36603 every 8 connection(s)
I20260620 14:56:19.445202 18077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:19.445986 18144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:19.449400 18144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44: Bootstrap starting.
I20260620 14:56:19.450165 18144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:19.450501 18144 log.cc:824] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:19.451517 18144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44: No bootstrap required, opened a new log
I20260620 14:56:19.453469 18144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36603 } }
I20260620 14:56:19.453680 18144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:19.453729 18144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6a0917907342b9a560a9b8a0dc6a44, State: Initialized, Role: FOLLOWER
I20260620 14:56:19.453971 18144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36603 } }
I20260620 14:56:19.454083 18144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:19.454133 18144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:19.454186 18144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:19.454687 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18077
I20260620 14:56:19.454795 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:19.454981 12754 external_mini_cluster.cc:1428] Setting key 68ecd71799c3d285162348a6bb29deff
I20260620 14:56:19.455152 18144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36603 } }
I20260620 14:56:19.455273 18144 leader_election.cc:302] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c6a0917907342b9a560a9b8a0dc6a44; no voters:
I20260620 14:56:19.455500 18144 leader_election.cc:288] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:19.455523 18147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:19.455813 18147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [term 1 LEADER]: Becoming Leader. State: Replica: 0c6a0917907342b9a560a9b8a0dc6a44, State: Running, Role: LEADER
I20260620 14:56:19.455909 18147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36603 } }
I20260620 14:56:19.455987 18144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:19.456311 18147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c6a0917907342b9a560a9b8a0dc6a44. Latest consensus state: current_term: 1 leader_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36603 } } }
I20260620 14:56:19.456456 18147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:19.456353 18149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6a0917907342b9a560a9b8a0dc6a44" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36603 } } }
I20260620 14:56:19.457173 18149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:19.457969 18157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:19.458598 18157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:19.460807 18157 catalog_manager.cc:1347] Generated new cluster ID: c789625f098a4e9caeb3751871ee5b71
I20260620 14:56:19.460889 18157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:19.463565 18151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:19.455789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.12.116.190:36603)
0620 14:56:19.457268 (+ 1479us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:19.457280 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:19.457324 (+ 44us) server_negotiation.cc:407] Connection header received
0620 14:56:19.457493 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:19.457502 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:19.457590 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:19.457763 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:19.458131 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.459663 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.461265 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.461765 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.461946 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.462772 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:19.462776 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:19.462777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:19.462981 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:19.463018 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:19.463030 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:19.463120 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:19.463198 (+ 78us) server_negotiation.cc:299] Negotiation successful
0620 14:56:19.463301 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1330,"thread_start_us":167,"threads_started":1}
I20260620 14:56:19.464708 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:56:19.485688 18157 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:19.486697 18157 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:19.500694 18157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c6a0917907342b9a560a9b8a0dc6a44: Generated new TSK 0
I20260620 14:56:19.501312 18157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:19.512776 18151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:19.509221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33408 (local address 127.12.116.190:36603)
0620 14:56:19.509291 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:19.509294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:19.509328 (+ 34us) server_negotiation.cc:407] Connection header received
0620 14:56:19.509434 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:19.509435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:19.509454 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:19.509535 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0620 14:56:19.509700 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.510231 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.511066 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.511288 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.511372 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.511574 (+ 202us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 14:56:19.512517 (+ 943us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39573/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0620 14:56:19.512690 (+ 173us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33408: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39573/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":42}
W20260620 14:56:19.512821 18173 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:19.509114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36603 (local address 127.0.0.1:33408)
0620 14:56:19.509259 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:19.509278 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:19.509352 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:19.509532 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:19.509533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:19.509535 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0620 14:56:19.509615 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:19.509617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.510321 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.510322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:19.510955 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:19.510957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.511375 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.511376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:19.511440 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.511446 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 14:56:19.512619 (+ 1173us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39573/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0620 14:56:19.512720 (+ 101us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.116.190:36603: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39573/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":95,"threads_started":1}
W20260620 14:56:19.512857 18151 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33408: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39573/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260620 14:56:19.513075 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18077
E20260620 14:56:19.525815 18174 webserver.cc:533] Webserver: sslize failed:
E20260620 14:56:19.525919 18174 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-06-20T14:56:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (266 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-06-20T14:56:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:19Z Disabled control of system clock
I20260620 14:56:19.562747 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36237
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:34135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36237
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/testchainca.cert with env {}
W20260620 14:56:19.658783 18178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:19.659162 18178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:19.659294 18178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:19.661649 18178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:19.661736 18178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:19.661751 18178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:19.661768 18178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:19.661783 18178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 14:56:19.661799 18178 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 14:56:19.661813 18178 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260620 14:56:19.664672 18178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:34135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36237
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:19.664971 18178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:19.665189 18178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:19.671253 18183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:19.671239 18186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:19.671293 18178 server_base.cc:1034] running on GCE node
W20260620 14:56:19.671239 18184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:19.671775 18178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:19.672169 18178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:19.673388 18178 hybrid_clock.cc:648] HybridClock initialized: now 1781967379673385 us; error 69 us; skew 500 ppm
I20260620 14:56:19.675730 18178 webserver.cc:460] Webserver started at http://127.12.116.190:36391/ using document root <none> and password file <none>
I20260620 14:56:19.676148 18178 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:19.676240 18178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:19.676486 18178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:19.678160 18178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "a67324b654c84af9a931f822fb3fb5ba"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "b60234532c9d2793b4782c96c290ba8b"
server_key_iv: "6bbcd2a1cfe11346fc55d0d8d1bd7bac"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.678673 18178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "a67324b654c84af9a931f822fb3fb5ba"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "b60234532c9d2793b4782c96c290ba8b"
server_key_iv: "6bbcd2a1cfe11346fc55d0d8d1bd7bac"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.680619 18178 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:56:19.681960 18192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:19.682176 18178 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:19.682303 18178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "a67324b654c84af9a931f822fb3fb5ba"
format_stamp: "Formatted at 2026-06-20 14:56:19 on dist-test-slave-7v06"
server_key: "b60234532c9d2793b4782c96c290ba8b"
server_key_iv: "6bbcd2a1cfe11346fc55d0d8d1bd7bac"
server_key_version: "encryptionkey@0"
I20260620 14:56:19.682397 18178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:19.695957 18178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:19.696432 18178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:19.696626 18178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:19.701494 18178 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:36237
I20260620 14:56:19.701642 18244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:36237 every 8 connection(s)
I20260620 14:56:19.702016 18178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:19.703192 18245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:19.706055 18245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba: Bootstrap starting.
I20260620 14:56:19.706730 18245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:19.707011 18245 log.cc:824] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:19.708266 18245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba: No bootstrap required, opened a new log
I20260620 14:56:19.709549 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18178
I20260620 14:56:19.709688 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:19.709949 12754 external_mini_cluster.cc:1428] Setting key 9c281e7906b70db99e5206bce8ba90a1
I20260620 14:56:19.711423 18245 raft_consensus.cc:348] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67324b654c84af9a931f822fb3fb5ba" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36237 } }
I20260620 14:56:19.711644 18245 raft_consensus.cc:374] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:19.711687 18245 raft_consensus.cc:729] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67324b654c84af9a931f822fb3fb5ba, State: Initialized, Role: FOLLOWER
I20260620 14:56:19.711859 18245 consensus_queue.cc:260] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67324b654c84af9a931f822fb3fb5ba" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36237 } }
I20260620 14:56:19.711966 18245 raft_consensus.cc:388] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:19.711992 18245 raft_consensus.cc:482] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:19.712069 18245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:19.713155 18245 raft_consensus.cc:504] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67324b654c84af9a931f822fb3fb5ba" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36237 } }
I20260620 14:56:19.713307 18245 leader_election.cc:302] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a67324b654c84af9a931f822fb3fb5ba; no voters:
I20260620 14:56:19.713519 18245 leader_election.cc:288] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:19.713577 18250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:19.713737 18250 raft_consensus.cc:686] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [term 1 LEADER]: Becoming Leader. State: Replica: a67324b654c84af9a931f822fb3fb5ba, State: Running, Role: LEADER
I20260620 14:56:19.713840 18245 sys_catalog.cc:564] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:19.713835 18250 consensus_queue.cc:237] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67324b654c84af9a931f822fb3fb5ba" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36237 } }
I20260620 14:56:19.714246 18250 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a67324b654c84af9a931f822fb3fb5ba. Latest consensus state: current_term: 1 leader_uuid: "a67324b654c84af9a931f822fb3fb5ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67324b654c84af9a931f822fb3fb5ba" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36237 } } }
I20260620 14:56:19.714263 18251 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a67324b654c84af9a931f822fb3fb5ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67324b654c84af9a931f822fb3fb5ba" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36237 } } }
I20260620 14:56:19.714370 18250 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:19.714402 18251 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:19.715391 18256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:19.716143 18256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:19.717990 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:19.710666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57818 (local address 127.12.116.190:36237)
0620 14:56:19.710952 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:19.710962 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:19.710992 (+ 30us) server_negotiation.cc:407] Connection header received
0620 14:56:19.711385 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:19.711392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:19.711460 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:19.711585 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:19.711894 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.713993 (+ 2099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.715136 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.715896 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.716035 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.716925 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:19.716929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:19.716930 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:19.717145 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:19.717193 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:19.717209 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:19.717288 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:19.717587 (+ 299us) server_negotiation.cc:299] Negotiation successful
0620 14:56:19.717752 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":107,"threads_started":1}
I20260620 14:56:19.718127 18256 catalog_manager.cc:1347] Generated new cluster ID: 0e7bee4b700d4f27bdec5cef1039f5c9
I20260620 14:56:19.718178 18256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:19.718847 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:56:19.733584 18256 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:19.734371 18256 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:19.739403 18256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a67324b654c84af9a931f822fb3fb5ba: Generated new TSK 0
I20260620 14:56:19.739876 18256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:19.768433 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:19.746080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57826 (local address 127.12.116.190:36237)
0620 14:56:19.746141 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:19.746143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:19.746215 (+ 72us) server_negotiation.cc:407] Connection header received
0620 14:56:19.746318 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:19.746319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:19.746330 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:19.746394 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0620 14:56:19.746563 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.747280 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.748539 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.748769 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.748850 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.749039 (+ 189us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 14:56:19.767976 (+ 18937us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0620 14:56:19.768297 (+ 321us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57826: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":30}
W20260620 14:56:19.768522 18249 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57826: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260620 14:56:19.768510 18274 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:19.745974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36237 (local address 127.0.0.1:57826)
0620 14:56:19.746149 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:19.746162 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:19.746238 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:19.746409 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:19.746410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:19.746412 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0620 14:56:19.746480 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:19.746482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.747412 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.747413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:19.748436 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:19.748440 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:19.748873 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:19.748874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:19.748938 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:19.748945 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 14:56:19.768250 (+ 19305us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0620 14:56:19.768406 (+ 156us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.116.190:36237: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260620 14:56:19.768962 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18178
2026-06-20T14:56:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (232 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (98 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (105 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:20 dist-test-slave-7v06 krb5kdc[18286](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:20 dist-test-slave-7v06 krb5kdc[18286](info): set up 2 sockets
Jun 20 14:56:20 dist-test-slave-7v06 krb5kdc[18286](info): commencing operation
krb5kdc: starting...
W20260620 14:56:21.105041 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:21.269726 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43087
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:21.366784 18299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:21.367221 18299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:21.367277 18299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:21.369407 18299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:21.369511 18299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:21.369539 18299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:21.369561 18299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:21.369590 18299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:21.372895 18299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:21.373317 18299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:21.373579 18299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:21.379223 18304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.379154 18307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.379604 18305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:21.379685 18299 server_base.cc:1034] running on GCE node
I20260620 14:56:21.379964 18299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:21.380378 18299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:21.381580 18299 hybrid_clock.cc:648] HybridClock initialized: now 1781967381381549 us; error 55 us; skew 500 ppm
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:21.384820 18299 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:21.385396 18299 webserver.cc:460] Webserver started at http://127.12.116.190:33881/ using document root <none> and password file <none>
I20260620 14:56:21.385653 18299 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:21.385737 18299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:21.385890 18299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:21.387070 18299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "51a86afd4277478284b89d3f3c468221"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "0f6fc1e56d8db9fb63f65f2bcd11dbd8"
server_key_iv: "492590f5f66739dab6e971def3a1ce0d"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.387487 18299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "51a86afd4277478284b89d3f3c468221"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "0f6fc1e56d8db9fb63f65f2bcd11dbd8"
server_key_iv: "492590f5f66739dab6e971def3a1ce0d"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.389213 18299 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:21.390265 18314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.390638 18299 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:21.390779 18299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "51a86afd4277478284b89d3f3c468221"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "0f6fc1e56d8db9fb63f65f2bcd11dbd8"
server_key_iv: "492590f5f66739dab6e971def3a1ce0d"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.390884 18299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:21.403399 18299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:21.406576 18299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:21.406802 18299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:21.411656 18299 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43087
I20260620 14:56:21.411700 18366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43087 every 8 connection(s)
I20260620 14:56:21.412106 18299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:21.413478 18367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:21.416617 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18299
I20260620 14:56:21.416757 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:21.416961 12754 external_mini_cluster.cc:1428] Setting key 2545ebcf47a793d149dc7501e73bf1f2
I20260620 14:56:21.417028 18367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221: Bootstrap starting.
I20260620 14:56:21.417825 18367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:21.418298 18367 log.cc:824] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:21.419229 18367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221: No bootstrap required, opened a new log
I20260620 14:56:21.421963 18367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51a86afd4277478284b89d3f3c468221" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43087 } }
I20260620 14:56:21.422186 18367 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:21.422223 18367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a86afd4277478284b89d3f3c468221, State: Initialized, Role: FOLLOWER
I20260620 14:56:21.422403 18367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51a86afd4277478284b89d3f3c468221" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43087 } }
I20260620 14:56:21.422472 18367 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:21.422513 18367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:21.422564 18367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:21.423405 18367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51a86afd4277478284b89d3f3c468221" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43087 } }
I20260620 14:56:21.423542 18367 leader_election.cc:302] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51a86afd4277478284b89d3f3c468221; no voters:
I20260620 14:56:21.423745 18367 leader_election.cc:288] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:21.423827 18372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:21.424019 18372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [term 1 LEADER]: Becoming Leader. State: Replica: 51a86afd4277478284b89d3f3c468221, State: Running, Role: LEADER
I20260620 14:56:21.424055 18367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:21.424226 18372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51a86afd4277478284b89d3f3c468221" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43087 } }
I20260620 14:56:21.424846 18373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51a86afd4277478284b89d3f3c468221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51a86afd4277478284b89d3f3c468221" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43087 } } }
I20260620 14:56:21.424875 18374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51a86afd4277478284b89d3f3c468221. Latest consensus state: current_term: 1 leader_uuid: "51a86afd4277478284b89d3f3c468221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51a86afd4277478284b89d3f3c468221" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43087 } } }
I20260620 14:56:21.424947 18373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:21.424957 18374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:21.425333 18376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:21.425927 18376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:21.427843 18376 catalog_manager.cc:1347] Generated new cluster ID: d9aea3bb4aae44ba96b44967eadb4a99
I20260620 14:56:21.427897 18376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:21.431715 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:21.417633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51152 (local address 127.12.116.190:43087)
0620 14:56:21.417909 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:21.417919 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:21.418033 (+ 114us) server_negotiation.cc:407] Connection header received
0620 14:56:21.418789 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:21.418797 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:21.418877 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:21.419059 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:21.420220 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.421903 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.422995 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.423686 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.423823 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:21.427423 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:21.427427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:21.427428 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:21.427444 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:21.429682 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:21.430310 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:21.430314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:21.430314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:21.430452 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:21.430678 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:21.430679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:21.430680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:21.431048 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:21.431224 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:21.431314 (+ 90us) server_negotiation.cc:299] Negotiation successful
0620 14:56:21.431473 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":104,"threads_started":1}
I20260620 14:56:21.437233 18376 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:21.437851 18376 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:21.450426 18376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51a86afd4277478284b89d3f3c468221: Generated new TSK 0
I20260620 14:56:21.450700 18376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:21.489619 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43087
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:21.584873 18393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:21.585172 18393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:21.585216 18393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:21.586705 18393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:21.586802 18393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:21.586854 18393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:21.588840 18393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:21.589213 18393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:21.589475 18393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:21.596645 18399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.596657 18401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.596657 18398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:21.597082 18393 server_base.cc:1034] running on GCE node
I20260620 14:56:21.597509 18393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:21.597828 18393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:21.599080 18393 hybrid_clock.cc:648] HybridClock initialized: now 1781967381599062 us; error 44 us; skew 500 ppm
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:21.603441 18393 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:21.604157 18393 webserver.cc:460] Webserver started at http://127.12.116.129:36165/ using document root <none> and password file <none>
I20260620 14:56:21.604475 18393 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:21.604552 18393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:21.604728 18393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:21.606037 18393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "0d339027d0de4f979fadb35d807581d0"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "787a68c0585e54409ce8dd3d327ed36e"
server_key_iv: "949f58af11d1ecabad1a912c837becc9"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.606458 18393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "0d339027d0de4f979fadb35d807581d0"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "787a68c0585e54409ce8dd3d327ed36e"
server_key_iv: "949f58af11d1ecabad1a912c837becc9"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.608398 18393 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:21.609730 18408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.610140 18393 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:21.610276 18393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "0d339027d0de4f979fadb35d807581d0"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "787a68c0585e54409ce8dd3d327ed36e"
server_key_iv: "949f58af11d1ecabad1a912c837becc9"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.610379 18393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:21.629665 18393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:21.632808 18393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:21.633005 18393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:21.633303 18393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:21.633657 18393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:21.633725 18393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.633770 18393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:21.633800 18393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.641110 18393 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:38951
I20260620 14:56:21.641160 18521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:38951 every 8 connection(s)
I20260620 14:56:21.641500 18393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:21.646757 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18393
I20260620 14:56:21.646900 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:21.647136 12754 external_mini_cluster.cc:1428] Setting key 525042ea72747e6ab6c2f7171854f944
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:21.653421 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:21.642306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:33297 (local address 127.12.116.190:43087)
0620 14:56:21.642364 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:21.642366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:21.642611 (+ 245us) server_negotiation.cc:407] Connection header received
0620 14:56:21.643701 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:21.643703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:21.643714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:21.643810 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:21.644681 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.645250 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.646315 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.646534 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.646638 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:21.649614 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:21.649616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:21.649616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:21.649626 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:21.651483 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:21.652061 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:21.652062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:21.652063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:21.652132 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:21.652512 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:21.652513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:21.652514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:21.652748 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:21.652836 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:21.653172 (+ 336us) server_negotiation.cc:299] Negotiation successful
0620 14:56:21.653277 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 14:56:21.653451 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:21.642319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43087 (local address 127.12.116.129:33297)
0620 14:56:21.642477 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:21.642517 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:21.643499 (+ 982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:21.643928 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:21.643932 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:21.644262 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:21.644581 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:21.644587 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.645350 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.645351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:21.646205 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:21.646207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.646651 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.646652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:21.646853 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:21.647550 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:21.647561 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:21.649482 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:21.651610 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:21.651618 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:21.651621 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:21.651959 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:21.652224 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:21.652225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:21.652225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:21.652426 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:21.652840 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:21.652846 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:21.652991 (+ 145us) client_negotiation.cc:769] Sending connection context
0620 14:56:21.653086 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 14:56:21.653250 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260620 14:56:21.654032 18522 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43087
I20260620 14:56:21.654150 18522 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:21.654381 18522 heartbeater.cc:511] Master 127.12.116.190:43087 requested a full tablet report, sending...
I20260620 14:56:21.654923 18331 ts_manager.cc:194] Registered new tserver with Master: 0d339027d0de4f979fadb35d807581d0 (127.12.116.129:38951)
I20260620 14:56:21.655561 18331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:33297
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:21.681229 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43087
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:21.774803 18527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:21.775067 18527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:21.775097 18527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:21.776536 18527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:21.776595 18527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:21.776628 18527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:21.778352 18527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:21.778604 18527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:21.778822 18527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:21.785008 18533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.784997 18535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.784997 18532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:21.785974 18527 server_base.cc:1034] running on GCE node
I20260620 14:56:21.786392 18527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:21.786762 18527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:21.788002 18527 hybrid_clock.cc:648] HybridClock initialized: now 1781967381787958 us; error 68 us; skew 500 ppm
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:21.792097 18527 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:21.792793 18527 webserver.cc:460] Webserver started at http://127.12.116.130:40461/ using document root <none> and password file <none>
I20260620 14:56:21.793044 18527 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:21.793115 18527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:21.793277 18527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:21.794549 18527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "8186e0fff53641a3b05c7fb570754b3e"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "0e2ab08e8afbb1549a859b23b5e7b36d"
server_key_iv: "537ca92b9900623b568d3c70775e4d0a"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.794957 18527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "8186e0fff53641a3b05c7fb570754b3e"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "0e2ab08e8afbb1549a859b23b5e7b36d"
server_key_iv: "537ca92b9900623b568d3c70775e4d0a"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.797194 18527 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 14:56:21.798449 18542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.799109 18527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:21.799386 18527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "8186e0fff53641a3b05c7fb570754b3e"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "0e2ab08e8afbb1549a859b23b5e7b36d"
server_key_iv: "537ca92b9900623b568d3c70775e4d0a"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.799584 18527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:21.823469 18527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:21.826565 18527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:21.827013 18527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:21.827373 18527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:21.827788 18527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:21.827844 18527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.827888 18527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:21.827926 18527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.835393 18527 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:33565
I20260620 14:56:21.835441 18655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:33565 every 8 connection(s)
I20260620 14:56:21.835834 18527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:21.837766 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18527
I20260620 14:56:21.837951 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:21.838187 12754 external_mini_cluster.cc:1428] Setting key 24009aa4a0d19b7eb0afb1099fcd9947
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:56:21.848246 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:21.837035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:48051 (local address 127.12.116.190:43087)
0620 14:56:21.837134 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:21.837137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:21.837152 (+ 15us) server_negotiation.cc:407] Connection header received
0620 14:56:21.838138 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:21.838140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:21.838155 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:21.838204 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:21.839161 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.839717 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.840857 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.841075 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.841171 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:21.844295 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:21.844298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:21.844298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:21.844308 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:21.846462 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:21.847052 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:21.847053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:21.847054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:21.847138 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:21.847447 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:21.847448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:21.847448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:21.847582 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:21.847656 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:21.848018 (+ 362us) server_negotiation.cc:299] Negotiation successful
0620 14:56:21.848121 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260620 14:56:21.848495 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:21.836735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43087 (local address 127.12.116.130:48051)
0620 14:56:21.836913 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:21.836962 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:21.838019 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:21.838286 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:21.838291 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:21.838708 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:21.839077 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:21.839085 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.839827 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.839829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:21.840746 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:21.840749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:21.841188 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:21.841189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:21.841340 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:21.841976 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:21.841985 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:21.844100 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:21.846612 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:21.846631 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:21.846634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:21.846958 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:21.847240 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:21.847241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:21.847242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:21.847371 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:21.847667 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:21.847675 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:21.847860 (+ 185us) client_negotiation.cc:769] Sending connection context
0620 14:56:21.847980 (+ 120us) client_negotiation.cc:240] Negotiation successful
0620 14:56:21.848182 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
I20260620 14:56:21.849197 18656 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43087
I20260620 14:56:21.849444 18656 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:21.849714 18656 heartbeater.cc:511] Master 127.12.116.190:43087 requested a full tablet report, sending...
I20260620 14:56:21.850271 18331 ts_manager.cc:194] Registered new tserver with Master: 8186e0fff53641a3b05c7fb570754b3e (127.12.116.130:33565)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
I20260620 14:56:21.850782 18331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:48051
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:21.868855 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43087
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:21.969063 18661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:21.969326 18661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:21.969355 18661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:21.970745 18661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:21.970820 18661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:21.970853 18661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:21.972785 18661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:21.973114 18661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:21.973416 18661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:21.979588 18666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.979806 18669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:21.979976 18667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:21.980423 18661 server_base.cc:1034] running on GCE node
I20260620 14:56:21.980692 18661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:21.981006 18661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:21.982208 18661 hybrid_clock.cc:648] HybridClock initialized: now 1781967381982164 us; error 90 us; skew 500 ppm
Jun 20 14:56:21 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:21.985394 18661 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:21.985906 18661 webserver.cc:460] Webserver started at http://127.12.116.131:42075/ using document root <none> and password file <none>
I20260620 14:56:21.986120 18661 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:21.986171 18661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:21.986275 18661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:21.987898 18661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "25c926f6e610434da0c2a375248150d7"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "98cbb173d49e1d9091103e647c4a736c"
server_key_iv: "5a6a20d9e8b27ad609f58f1a02803b7a"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.988655 18661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "25c926f6e610434da0c2a375248150d7"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "98cbb173d49e1d9091103e647c4a736c"
server_key_iv: "5a6a20d9e8b27ad609f58f1a02803b7a"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.990320 18661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:56:21.991307 18676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:21.991529 18661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:21.991672 18661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "25c926f6e610434da0c2a375248150d7"
format_stamp: "Formatted at 2026-06-20 14:56:21 on dist-test-slave-7v06"
server_key: "98cbb173d49e1d9091103e647c4a736c"
server_key_iv: "5a6a20d9e8b27ad609f58f1a02803b7a"
server_key_version: "encryptionkey@0"
I20260620 14:56:21.991775 18661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:22.001771 18661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:22.005350 18661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:22.005496 18661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:22.006026 18661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:22.006584 18661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:22.006644 18661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:22.006672 18661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:22.006685 18661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:22.015347 18661 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:41971
I20260620 14:56:22.015386 18789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:41971 every 8 connection(s)
I20260620 14:56:22.015795 18661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967381, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:22.025200 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18661
I20260620 14:56:22.025323 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:22.025532 12754 external_mini_cluster.cc:1428] Setting key b2e19b59feb437babb3a144e56605946
I20260620 14:56:22.028872 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:22.017221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:36729 (local address 127.12.116.190:43087)
0620 14:56:22.017328 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.017330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.017655 (+ 325us) server_negotiation.cc:407] Connection header received
0620 14:56:22.018949 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.018995 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.019028 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.019118 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.020040 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.020735 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.021986 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.022220 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.022306 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:22.025076 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:22.025079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:22.025079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:22.025089 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:22.027125 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.027665 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.027666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.027667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.027743 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.028032 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.028033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.028034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.028175 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:22.028251 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:22.028689 (+ 438us) server_negotiation.cc:299] Negotiation successful
0620 14:56:22.028795 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260620 14:56:22.029034 18792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:22.017175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43087 (local address 127.12.116.131:36729)
0620 14:56:22.017420 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:22.017468 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:22.018742 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:22.019279 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:22.019286 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:22.019642 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:22.019888 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:22.019894 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.020875 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.020877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:22.021819 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:22.021822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.022322 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.022323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:22.022444 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:22.023121 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:22.023131 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:22.024902 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:22.027231 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:22.027241 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:22.027243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:22.027560 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:22.027821 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:22.027822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:22.027822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:22.027941 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:22.028270 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:22.028277 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:22.028528 (+ 251us) client_negotiation.cc:769] Sending connection context
0620 14:56:22.028644 (+ 116us) client_negotiation.cc:240] Negotiation successful
0620 14:56:22.028804 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":155,"threads_started":1}
I20260620 14:56:22.029623 18790 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43087
I20260620 14:56:22.029758 18790 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:22.029965 18790 heartbeater.cc:511] Master 127.12.116.190:43087 requested a full tablet report, sending...
I20260620 14:56:22.030687 18331 ts_manager.cc:194] Registered new tserver with Master: 25c926f6e610434da0c2a375248150d7 (127.12.116.131:41971)
I20260620 14:56:22.031138 18331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:36729
I20260620 14:56:22.037479 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/test-admin.keytab.
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.060266 12754 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260620 14:56:22.063189 18797 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:22.061909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52880 (local address 127.12.116.129:38951)
0620 14:56:22.062199 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.062205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.062216 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:22.062246 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.062248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.062266 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.062363 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.063061 (+ 698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52880: BlockingRecv error: recv got EOF from 127.0.0.1:52880 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
W20260620 14:56:22.063371 12754 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc' of type FILE
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.064790 12754 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.065893 12754 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:56:22.076184 18797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:22.066767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.12.116.129:38951)
0620 14:56:22.066947 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.066950 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.067052 (+ 102us) server_negotiation.cc:407] Connection header received
0620 14:56:22.067157 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.067159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.067178 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.067248 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.067733 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.068599 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.069388 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.069776 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.069869 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:22.072877 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:22.072891 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:22.072892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:22.072901 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:22.074820 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.075273 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.075276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.075277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.075344 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.075550 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.075551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.075551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.075726 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:22.075906 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:22.075956 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 14:56:22.076069 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260620 14:56:22.078742 12754 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc' of type FILE
W20260620 14:56:22.078753 18797 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:22.078040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52896 (local address 127.12.116.129:38951)
0620 14:56:22.078085 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.078087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.078122 (+ 35us) server_negotiation.cc:407] Connection header received
0620 14:56:22.078184 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.078185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.078195 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.078251 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.078651 (+ 400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52896: BlockingRecv error: recv got EOF from 127.0.0.1:52896 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.080157 12754 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.081403 12754 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:56:22.090320 18797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:22.082071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52902 (local address 127.12.116.129:38951)
0620 14:56:22.082211 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.082215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.082324 (+ 109us) server_negotiation.cc:407] Connection header received
0620 14:56:22.082581 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.082583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.082602 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.082691 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.083144 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.083661 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.084438 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.084655 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.084758 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:22.087518 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:22.087520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:22.087520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:22.087539 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:22.089082 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.089479 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.089481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.089481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.089539 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.089747 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.089748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.089749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.089866 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:22.089975 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:22.090104 (+ 129us) server_negotiation.cc:299] Negotiation successful
0620 14:56:22.090201 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260620 14:56:22.092795 18797 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:22.091984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.12.116.129:38951)
0620 14:56:22.092067 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.092070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.092158 (+ 88us) server_negotiation.cc:407] Connection header received
0620 14:56:22.092232 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.092233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.092244 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.092315 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.092725 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52910: BlockingRecv error: recv got EOF from 127.0.0.1:52910 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260620 14:56:22.092918 12754 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781967351633327-12754-0/krb5kdc/krb5cc' of type FILE
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.094125 12754 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:22.095305 12754 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:56:22.106086 18797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:22.096082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52914 (local address 127.12.116.129:38951)
0620 14:56:22.096150 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:22.096153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:22.096184 (+ 31us) server_negotiation.cc:407] Connection header received
0620 14:56:22.096293 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:22.096294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:22.096312 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:22.096410 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:22.097131 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.097655 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.098391 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:22.098590 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:22.098689 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:22.101990 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:22.101993 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:22.101993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:22.102005 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:22.104222 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.104884 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.104886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.104886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.104973 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:22.105289 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:22.105290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:22.105291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:22.105459 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:22.105565 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:22.105904 (+ 339us) server_negotiation.cc:299] Negotiation successful
0620 14:56:22.106006 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 14:56:22.107107 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18393
I20260620 14:56:22.113376 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18527
I20260620 14:56:22.118403 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18661
I20260620 14:56:22.123404 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18299
2026-06-20T14:56:22Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2154 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18810](info): set up 2 sockets
Jun 20 14:56:22 dist-test-slave-7v06 krb5kdc[18810](info): commencing operation
krb5kdc: starting...
W20260620 14:56:23.268254 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:23 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:23Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab.
Entry for principal oryx/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab.
I20260620 14:56:23.426612 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38675
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab
--principal=oryx/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:38675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:23.526160 18823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:23.526470 18823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:23.526512 18823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:23.527894 18823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:23.527994 18823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:23.528020 18823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:23.528040 18823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:23.528059 18823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:23.529925 18823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:38675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab
--principal=oryx/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:23.530295 18823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:23.530576 18823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:23.536770 18828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:23.536777 18831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:23.537127 18829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:23.537302 18823 server_base.cc:1034] running on GCE node
I20260620 14:56:23.537638 18823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:23.538017 18823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:23.539269 18823 hybrid_clock.cc:648] HybridClock initialized: now 1781967383539203 us; error 89 us; skew 500 ppm
Jun 20 14:56:23 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:23.543094 18823 init.cc:377] Logged in from keytab as oryx/127.12.116.190@KRBTEST.COM (short username oryx)
I20260620 14:56:23.543709 18823 webserver.cc:460] Webserver started at http://127.12.116.190:37213/ using document root <none> and password file <none>
I20260620 14:56:23.543977 18823 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:23.544051 18823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:23.544212 18823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:23.545475 18823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "836ae634df5a4cda8f288bbd35d30a5a"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "65775cfd348818c090d29f9c1921606b"
server_key_iv: "efb45200704fe0208a73df6dc892142c"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.545943 18823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "836ae634df5a4cda8f288bbd35d30a5a"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "65775cfd348818c090d29f9c1921606b"
server_key_iv: "efb45200704fe0208a73df6dc892142c"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.547551 18823 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:23.548731 18838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:23.549115 18823 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:23.549263 18823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "836ae634df5a4cda8f288bbd35d30a5a"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "65775cfd348818c090d29f9c1921606b"
server_key_iv: "efb45200704fe0208a73df6dc892142c"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.549377 18823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:23.563803 18823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:23.566748 18823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:23.566955 18823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:23.571957 18823 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:38675
I20260620 14:56:23.572064 18890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:38675 every 8 connection(s)
I20260620 14:56:23.572431 18823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:23.573534 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18823
I20260620 14:56:23.573701 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:23.573746 18891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:23.573930 12754 external_mini_cluster.cc:1428] Setting key 4f5d76d71ea232eabaf8b5b6330b4a41
I20260620 14:56:23.577714 18891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Bootstrap starting.
I20260620 14:56:23.578619 18891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:23.578965 18891 log.cc:824] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:23.579787 18891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: No bootstrap required, opened a new log
Jun 20 14:56:23 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:23.582935 18891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } }
I20260620 14:56:23.583140 18891 raft_consensus.cc:374] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:23.583182 18891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836ae634df5a4cda8f288bbd35d30a5a, State: Initialized, Role: FOLLOWER
I20260620 14:56:23.583390 18891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } }
I20260620 14:56:23.583505 18891 raft_consensus.cc:388] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:23.583542 18891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:23.583611 18891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:23.584573 18891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } }
I20260620 14:56:23.584728 18891 leader_election.cc:302] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 836ae634df5a4cda8f288bbd35d30a5a; no voters:
I20260620 14:56:23.585130 18891 leader_election.cc:288] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:23.585167 18896 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:23.585351 18896 raft_consensus.cc:686] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 LEADER]: Becoming Leader. State: Replica: 836ae634df5a4cda8f288bbd35d30a5a, State: Running, Role: LEADER
I20260620 14:56:23.585449 18896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } }
I20260620 14:56:23.585536 18891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:23.585937 18898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 836ae634df5a4cda8f288bbd35d30a5a. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } }
I20260620 14:56:23.586054 18898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:23.586350 18900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:23.585937 18897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } }
I20260620 14:56:23.587075 18900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:23.587087 18897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:23.587725 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:23.574736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54876 (local address 127.12.116.190:38675)
0620 14:56:23.575068 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:23.575079 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:23.575110 (+ 31us) server_negotiation.cc:407] Connection header received
0620 14:56:23.575586 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:23.575594 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:23.575649 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:23.575791 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:23.576736 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:23.577672 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:23.578787 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:23.579346 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:23.579488 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:23.582560 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:23.582567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:23.582568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:23.582584 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:23.585015 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:23.585539 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:23.585543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:23.585544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:23.585673 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:23.585963 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:23.585965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:23.585965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:23.586380 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:23.587101 (+ 721us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:23.587211 (+ 110us) server_negotiation.cc:299] Negotiation successful
0620 14:56:23.587499 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":141,"threads_started":1}
I20260620 14:56:23.589458 18900 catalog_manager.cc:1347] Generated new cluster ID: 9dcfdfef212f43ada712c31ae0149293
I20260620 14:56:23.589532 18900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:23.594548 18900 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:23.595207 18900 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:23.598954 18900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Generated new TSK 0
I20260620 14:56:23.599211 18900 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab.
Entry for principal oryx/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab.
I20260620 14:56:23.635764 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38675
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:23.748250 18917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:23.748623 18917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:23.748658 18917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:23.750187 18917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:23.750273 18917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:23.750308 18917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:23.756757 18917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:23.757133 18917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:23.757458 18917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:23.764631 18925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:23.764632 18922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:23.764885 18917 server_base.cc:1034] running on GCE node
W20260620 14:56:23.764719 18923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:23.765225 18917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:23.765583 18917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:23.766861 18917 hybrid_clock.cc:648] HybridClock initialized: now 1781967383766834 us; error 84 us; skew 500 ppm
Jun 20 14:56:23 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:23.771632 18917 init.cc:377] Logged in from keytab as oryx/127.12.116.129@KRBTEST.COM (short username oryx)
I20260620 14:56:23.772871 18917 webserver.cc:460] Webserver started at http://127.12.116.129:38075/ using document root <none> and password file <none>
I20260620 14:56:23.773196 18917 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:23.773277 18917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:23.773461 18917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:23.774878 18917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "4aef9f1a940044f6b939273112044613"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "89d7def08dd030a9b4fc150698503a0d"
server_key_iv: "07859d0be130cea9165f0cc79543de11"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.775730 18917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "4aef9f1a940044f6b939273112044613"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "89d7def08dd030a9b4fc150698503a0d"
server_key_iv: "07859d0be130cea9165f0cc79543de11"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.778281 18917 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.004s
I20260620 14:56:23.779676 18932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:23.780125 18917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:23.780388 18917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "4aef9f1a940044f6b939273112044613"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "89d7def08dd030a9b4fc150698503a0d"
server_key_iv: "07859d0be130cea9165f0cc79543de11"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.780541 18917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:23.810448 18917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:23.814221 18917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:23.814482 18917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:23.814786 18917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:23.815196 18917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:23.815259 18917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:23.815305 18917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:23.815336 18917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:23.823256 18917 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:33625
I20260620 14:56:23.823304 19045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:33625 every 8 connection(s)
I20260620 14:56:23.823745 18917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
Jun 20 14:56:23 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:23.833868 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 18917
I20260620 14:56:23.834012 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:23.834235 12754 external_mini_cluster.cc:1428] Setting key a3fdf4daa7fa1a839ed63f2cb27a1027
I20260620 14:56:23.836037 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:23.824762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:49589 (local address 127.12.116.190:38675)
0620 14:56:23.824839 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:23.824842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:23.824980 (+ 138us) server_negotiation.cc:407] Connection header received
0620 14:56:23.825602 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:23.825603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:23.825617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:23.825669 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:23.826732 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:23.827375 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:23.828559 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:23.828780 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:23.828877 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:23.831784 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:23.831787 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:23.831789 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:23.831803 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:23.833818 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:23.834424 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:23.834425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:23.834426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:23.834496 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:23.834800 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:23.834801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:23.834802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:23.834934 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:23.835014 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:23.835689 (+ 675us) server_negotiation.cc:299] Negotiation successful
0620 14:56:23.835914 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260620 14:56:23.836242 19048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:23.824594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:49589)
0620 14:56:23.824821 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:23.824875 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:23.825465 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:23.825746 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:23.825751 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:23.826399 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:23.826608 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:23.826613 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:23.827532 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:23.827534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:23.828453 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:23.828456 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:23.828892 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:23.828893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:23.829021 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:23.829601 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:23.829616 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:23.831643 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:23.833952 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:23.833966 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:23.833970 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:23.834351 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:23.834572 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:23.834573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:23.834573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:23.834715 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:23.835004 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:23.835011 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:23.835184 (+ 173us) client_negotiation.cc:769] Sending connection context
0620 14:56:23.835330 (+ 146us) client_negotiation.cc:240] Negotiation successful
0620 14:56:23.835890 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260620 14:56:23.837224 19046 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38675
I20260620 14:56:23.837376 19046 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:23.837817 19046 heartbeater.cc:511] Master 127.12.116.190:38675 requested a full tablet report, sending...
I20260620 14:56:23.838701 18855 ts_manager.cc:194] Registered new tserver with Master: 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625)
I20260620 14:56:23.839448 18855 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:49589
WARNING: no policy specified for oryx/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab.
Entry for principal oryx/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab.
I20260620 14:56:23.867579 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38675
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:23.963542 19051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:23.963812 19051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:23.963840 19051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:23.965252 19051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:23.965320 19051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:23.965353 19051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:23.967360 19051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:23.967850 19051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:23.968102 19051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:23.976197 19059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:23.976533 19057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:23.976671 19056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:23.977211 19051 server_base.cc:1034] running on GCE node
I20260620 14:56:23.977716 19051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:23.978425 19051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:23.979894 19051 hybrid_clock.cc:648] HybridClock initialized: now 1781967383979863 us; error 48 us; skew 500 ppm
Jun 20 14:56:23 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:23.983614 19051 init.cc:377] Logged in from keytab as oryx/127.12.116.130@KRBTEST.COM (short username oryx)
I20260620 14:56:23.984524 19051 webserver.cc:460] Webserver started at http://127.12.116.130:43063/ using document root <none> and password file <none>
I20260620 14:56:23.984892 19051 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:23.984959 19051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:23.985138 19051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:23.986651 19051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "c9085e544cd1446aa4c35c86d1a37219"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "ec92db7320e746e966252f5cebf9ae2b"
server_key_iv: "c0e944671f7f7c688cc419908c827ded"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.987109 19051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "c9085e544cd1446aa4c35c86d1a37219"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "ec92db7320e746e966252f5cebf9ae2b"
server_key_iv: "c0e944671f7f7c688cc419908c827ded"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.988965 19051 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 14:56:23.990188 19066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:23.990477 19051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:23.990592 19051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "c9085e544cd1446aa4c35c86d1a37219"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "ec92db7320e746e966252f5cebf9ae2b"
server_key_iv: "c0e944671f7f7c688cc419908c827ded"
server_key_version: "encryptionkey@0"
I20260620 14:56:23.990660 19051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:23.998719 19051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:24.001827 19051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:24.001992 19051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:24.002192 19051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:24.002574 19051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:24.002638 19051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.002686 19051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:24.002720 19051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.010295 19051 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:36227
I20260620 14:56:24.010390 19179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:36227 every 8 connection(s)
I20260620 14:56:24.010820 19051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:24.015239 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19051
I20260620 14:56:24.015477 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:24.015691 12754 external_mini_cluster.cc:1428] Setting key c6b8f1590acd6cc34c0f0576c1d38401
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:56:24.029889 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.013194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:59085 (local address 127.12.116.190:38675)
0620 14:56:24.013444 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.013449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.014010 (+ 561us) server_negotiation.cc:407] Connection header received
0620 14:56:24.014990 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.014992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.015009 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.015063 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.016514 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.017045 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.019855 (+ 2810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.020100 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.020213 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.025761 (+ 5548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.025763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.025764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.025785 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.027926 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.028586 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.028587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.028588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.028661 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.029040 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.029041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.029041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.029176 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.029271 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.029621 (+ 350us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.029737 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.131@KRBTEST.COM" created.
I20260620 14:56:24.030314 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.012511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:59085)
0620 14:56:24.013138 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.013495 (+ 357us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.014787 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.015159 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.015163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.016070 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.016395 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.016405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.017381 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.017384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.019595 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.019606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.020272 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.020274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.020711 (+ 437us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.021697 (+ 986us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.021712 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.024301 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.028066 (+ 3765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.028084 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.028087 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.028494 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.028776 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.028778 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.028778 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.028920 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.029259 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.029268 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.029459 (+ 191us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.029585 (+ 126us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.029819 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":124,"threads_started":1}
I20260620 14:56:24.031378 19180 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38675
I20260620 14:56:24.031630 19180 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:24.032055 19180 heartbeater.cc:511] Master 127.12.116.190:38675 requested a full tablet report, sending...
I20260620 14:56:24.033219 18855 ts_manager.cc:194] Registered new tserver with Master: c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227)
I20260620 14:56:24.033665 18855 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:59085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab.
Entry for principal oryx/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab.
I20260620 14:56:24.060796 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38675
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:24.166960 19185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:24.167204 19185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:24.167234 19185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:24.168733 19185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:24.168800 19185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:24.168834 19185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:24.172781 19185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:24.173156 19185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:24.173455 19185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:24.180573 19193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.180578 19191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.180578 19190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:24.181684 19185 server_base.cc:1034] running on GCE node
I20260620 14:56:24.182231 19185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:24.182816 19185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:24.184055 19185 hybrid_clock.cc:648] HybridClock initialized: now 1781967384184053 us; error 64 us; skew 500 ppm
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:24.188702 19185 init.cc:377] Logged in from keytab as oryx/127.12.116.131@KRBTEST.COM (short username oryx)
I20260620 14:56:24.189255 19185 webserver.cc:460] Webserver started at http://127.12.116.131:41185/ using document root <none> and password file <none>
I20260620 14:56:24.189523 19185 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.189597 19185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.189765 19185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:24.191880 19185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "769d010c9afb417398874508b38952cc"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "e7ea80ff5c043259c456e50c24cc6258"
server_key_iv: "6f0beda7bf804e9f745230f51c734b8c"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.192682 19185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "769d010c9afb417398874508b38952cc"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "e7ea80ff5c043259c456e50c24cc6258"
server_key_iv: "6f0beda7bf804e9f745230f51c734b8c"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.194832 19185 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260620 14:56:24.196700 19200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.197206 19185 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260620 14:56:24.198078 19185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "769d010c9afb417398874508b38952cc"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "e7ea80ff5c043259c456e50c24cc6258"
server_key_iv: "6f0beda7bf804e9f745230f51c734b8c"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.198338 19185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.215389 19185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:24.218919 19185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:24.219194 19185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:24.219786 19185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:24.220409 19185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:24.220471 19185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.220510 19185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:24.220537 19185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.228098 19185 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:43267
I20260620 14:56:24.228163 19313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:43267 every 8 connection(s)
I20260620 14:56:24.228543 19185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:24.238472 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19185
I20260620 14:56:24.238600 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:24.238817 12754 external_mini_cluster.cc:1428] Setting key cdc0aad5762e1873ee7ccf260ee64872
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:24.243353 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.229397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:37523 (local address 127.12.116.190:38675)
0620 14:56:24.229448 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.229451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.229642 (+ 191us) server_negotiation.cc:407] Connection header received
0620 14:56:24.230865 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.230867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.230880 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.230939 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.232814 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.233339 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.235947 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.236416 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.236523 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.239644 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.239646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.239647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.239656 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.241557 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.242207 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.242208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.242209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.242283 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.242584 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.242585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.242585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.242733 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.242810 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.243144 (+ 334us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.243247 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 14:56:24.243613 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.229286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:37523)
0620 14:56:24.229491 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.229537 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.230077 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.231014 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.231018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.231789 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.232032 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.232038 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.233795 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.233798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.235717 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.235724 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.236597 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.236599 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.236769 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.237386 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.237397 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.239495 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.241692 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.241704 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.241708 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.242088 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.242364 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.242365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.242365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.242501 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.242812 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.242825 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.242993 (+ 168us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.243110 (+ 117us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.243318 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":100,"threads_started":1}
I20260620 14:56:24.244457 19314 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38675
I20260620 14:56:24.244576 19314 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:24.244757 19314 heartbeater.cc:511] Master 127.12.116.190:38675 requested a full tablet report, sending...
I20260620 14:56:24.245328 18855 ts_manager.cc:194] Registered new tserver with Master: 769d010c9afb417398874508b38952cc (127.12.116.131:43267)
I20260620 14:56:24.245731 18855 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:37523
I20260620 14:56:24.253321 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.116.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.189.keytab.
Entry for principal oryx/127.12.116.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.189.keytab.
I20260620 14:56:24.293941 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:41665
--webserver_interface=127.12.116.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.189.keytab
--principal=oryx/127.12.116.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:38675,127.12.116.189:41665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:24.398898 19319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:24.399205 19319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:24.399237 19319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:24.401618 19319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:24.401705 19319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:24.401728 19319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:24.401742 19319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:24.401755 19319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:24.403832 19319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:38675,127.12.116.189:41665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.189.keytab
--principal=oryx/127.12.116.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:41665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.116.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
W20260620 14:56:24.403995 19319 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.116.190:38675,127.12.116.189:41665'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260620 14:56:24.404137 19319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:24.404433 19319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:24.410030 19327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.410281 19324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.410310 19325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:24.410578 19319 server_base.cc:1034] running on GCE node
I20260620 14:56:24.410842 19319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:24.411173 19319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:24.412482 19319 hybrid_clock.cc:648] HybridClock initialized: now 1781967384412480 us; error 125 us; skew 500 ppm
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:24.416440 19319 init.cc:377] Logged in from keytab as oryx/127.12.116.189@KRBTEST.COM (short username oryx)
I20260620 14:56:24.419939 19319 webserver.cc:460] Webserver started at http://127.12.116.189:43179/ using document root <none> and password file <none>
I20260620 14:56:24.420439 19319 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.420540 19319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.420734 19319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:24.422482 19319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/instance:
uuid: "880bb7f4673e455a81357bcc53362d19"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "4bf9f4cd20f905ea39f519d61affafc6"
server_key_iv: "715d9529b5f8416593a0fbebeb46cb45"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.423028 19319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal/instance:
uuid: "880bb7f4673e455a81357bcc53362d19"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "4bf9f4cd20f905ea39f519d61affafc6"
server_key_iv: "715d9529b5f8416593a0fbebeb46cb45"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.424901 19319 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 14:56:24.426043 19334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.426272 19319 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:24.426401 19319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
uuid: "880bb7f4673e455a81357bcc53362d19"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "4bf9f4cd20f905ea39f519d61affafc6"
server_key_iv: "715d9529b5f8416593a0fbebeb46cb45"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.426494 19319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.442857 19319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:24.445842 19319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:24.446061 19319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:24.452515 19319 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.189:41665
I20260620 14:56:24.452535 19386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.189:41665 every 8 connection(s)
I20260620 14:56:24.453717 19319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
I20260620 14:56:24.455245 19387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:24.457494 19387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:56:24.461663 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19319
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.189@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
I20260620 14:56:24.469908 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.458448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54888 (local address 127.12.116.190:38675)
0620 14:56:24.458558 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.458563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.458791 (+ 228us) server_negotiation.cc:407] Connection header received
0620 14:56:24.459301 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.459302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.459314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.459390 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.460166 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.460877 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.462626 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.463100 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.463211 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.466400 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.466402 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.466402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.466411 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.468046 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.468628 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.468630 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.468630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.468696 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.468995 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.468996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.468996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.469183 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.469267 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.469593 (+ 326us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.469809 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260620 14:56:24.470125 19389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.458401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:54888)
0620 14:56:24.458608 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.458657 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.459198 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.459468 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.459472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.459772 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.459993 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.459997 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.461049 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.461051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.462481 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.462486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.463329 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.463331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.463509 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.464197 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.464208 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.466264 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.468171 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.468182 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.468185 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.468539 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.468768 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.468769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.468769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.468901 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.469257 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.469263 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.469442 (+ 179us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.469565 (+ 123us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.469858 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":123,"threads_started":1}
I20260620 14:56:24.471122 19387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:56:24.475987 19391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.462415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53962 (local address 127.12.116.189:41665)
0620 14:56:24.462695 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.462702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.462729 (+ 27us) server_negotiation.cc:407] Connection header received
0620 14:56:24.462764 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.462766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.462793 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.462891 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.463582 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.464793 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.466038 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.466494 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.466581 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.470442 (+ 3861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.470449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.470449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.470459 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.473713 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.474541 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.474547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.474547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.474636 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.475068 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.475069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.475070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.475353 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.475544 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.475734 (+ 190us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.475867 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":169,"threads_started":1}
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.189@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
I20260620 14:56:24.481902 19389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.471475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:53968)
0620 14:56:24.471943 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.471960 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.472084 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.472460 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.472462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.472649 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.472717 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.472719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.473553 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.473554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.474394 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.474397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.475375 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.475377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.475547 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.476399 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.476405 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.478012 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.480791 (+ 2779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.480792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.480793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.481004 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.481297 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.481297 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.481298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.481355 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.481623 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.481624 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.481673 (+ 49us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.481736 (+ 63us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.481824 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390}
I20260620 14:56:24.482067 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.471505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53968 (local address 127.12.116.189:41665)
0620 14:56:24.471744 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.471747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.472070 (+ 323us) server_negotiation.cc:407] Connection header received
0620 14:56:24.472186 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.472187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.472201 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.472455 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.472804 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.473442 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.474727 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.475197 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.475300 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.478170 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.478172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.478172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.478182 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.480624 (+ 2442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.481114 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.481115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.481115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.481179 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.481436 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.481436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.481437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.481557 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.481613 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.481813 (+ 200us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.481885 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":101,"threads_started":1}
I20260620 14:56:24.483498 19387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Bootstrap starting.
I20260620 14:56:24.484323 19387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:24.484710 19387 log.cc:824] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:24.485778 19387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: No bootstrap required, opened a new log
I20260620 14:56:24.487468 19387 raft_consensus.cc:348] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } }
I20260620 14:56:24.487619 19387 raft_consensus.cc:374] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:24.487645 19387 raft_consensus.cc:729] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880bb7f4673e455a81357bcc53362d19, State: Initialized, Role: FOLLOWER
I20260620 14:56:24.487746 19387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } }
I20260620 14:56:24.488011 19394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } } }
I20260620 14:56:24.488102 19394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:56:24.488106 19387 sys_catalog.cc:564] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: configured and running, proceeding with master startup.
W20260620 14:56:24.489792 19405 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:56:24.489864 19405 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:56:24.492830 19319 master_runner.cc:428] Detected that this master 880bb7f4673e455a81357bcc53362d19 is joining an existing cluster
I20260620 14:56:24.492935 19319 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.116.189:41665
I20260620 14:56:24.502156 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.494306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53978 (local address 127.12.116.189:41665)
0620 14:56:24.494666 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.494669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.494686 (+ 17us) server_negotiation.cc:407] Connection header received
0620 14:56:24.494724 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.494725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.494743 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.494824 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.495207 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.495809 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.497382 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.497658 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.497742 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.498892 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.498893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.498894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.498900 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.500812 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.501371 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.501372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.501372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.501433 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.501595 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.501596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.501596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.501713 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.501791 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.501923 (+ 132us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.502035 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330}
I20260620 14:56:24.502247 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.494664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54890 (local address 127.12.116.190:38675)
0620 14:56:24.494714 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.494716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.495011 (+ 295us) server_negotiation.cc:407] Connection header received
0620 14:56:24.495138 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.495139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.495154 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.495188 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.495745 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.496310 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.497140 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.497369 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.497437 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.498743 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.498744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.498745 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.498753 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.500658 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.501272 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.501273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.501274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.501352 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.501539 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.501540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.501541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.501701 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.501790 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.502020 (+ 230us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.502155 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:24.502624 19412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.494335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:54890)
0620 14:56:24.494939 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.494950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.495038 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.495262 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.495263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.495537 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.495625 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.495628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.496459 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.496460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.497037 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.497039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.497546 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.497547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.497625 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.498192 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.498197 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.498619 (+ 422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.500773 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.500774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.500775 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.501180 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.501405 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.501406 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.501406 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.501482 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.501819 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.501820 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.501876 (+ 56us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.502400 (+ 524us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.502514 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":14,"thread_start_us":134,"threads_started":1}
I20260620 14:56:24.502296 19411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.494289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:53978)
0620 14:56:24.494489 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.494503 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.494573 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.494835 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.494836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.495018 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.495109 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.495111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.496025 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.496027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.497278 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.497281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.497789 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.497791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.497871 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.498372 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.498376 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.498801 (+ 425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.500898 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.500899 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.500899 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.501280 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.501491 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.501492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.501492 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.501546 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.501781 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.501782 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.501822 (+ 40us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.501896 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.502151 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":104,"thread_start_us":135,"threads_started":1}
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.190@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
I20260620 14:56:24.516129 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.506230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53994 (local address 127.12.116.189:41665)
0620 14:56:24.506300 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.506303 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.506498 (+ 195us) server_negotiation.cc:407] Connection header received
0620 14:56:24.506579 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.506580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.506591 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.506643 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.507254 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.507775 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.509545 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.509763 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.509867 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.513107 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.513109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.513109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.513125 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.514723 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.515220 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.515222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.515222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.515287 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.515500 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.515501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.515501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.515627 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.515701 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.515938 (+ 237us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.516024 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 14:56:24.516146 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.506154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:53994)
0620 14:56:24.506357 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.506404 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.506495 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.506658 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.506662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.507075 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.507149 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.507152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.507872 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.507873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.509355 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.509366 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.509898 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.509899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.510023 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.510901 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.510908 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.512978 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.514844 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.514858 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.514861 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.515126 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.515364 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.515365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.515365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.515435 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.515707 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.515718 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.515795 (+ 77us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.515885 (+ 90us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.516039 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":141,"threads_started":1}
I20260620 14:56:24.516820 18855 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.116.189:41665: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "880bb7f4673e455a81357bcc53362d19"
member_type: NON_VOTER
last_known_addr {
host: "127.12.116.189"
port: 41665
}
attrs {
promote: true
}
}
dest_uuid: "836ae634df5a4cda8f288bbd35d30a5a"
cas_config_opid_index: -1
I20260620 14:56:24.517149 18855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } }
I20260620 14:56:24.517725 19415 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 880bb7f4673e455a81357bcc53362d19 (127.12.116.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } }
I20260620 14:56:24.518056 19361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:24.518769 19415 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.116.189:41665
I20260620 14:56:24.519006 19414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } }
I20260620 14:56:24.519048 19361 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Refusing update from remote peer 836ae634df5a4cda8f288bbd35d30a5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260620 14:56:24.519145 19319 master.cc:537] Master@127.12.116.189:41665 shutting down...
I20260620 14:56:24.519178 19414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:24.519410 19414 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:56:24.520201 18840 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260620 14:56:24.520747 18840 consensus_peers.cc:487] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a -> Peer 880bb7f4673e455a81357bcc53362d19 (127.12.116.189:41665): Couldn't send request to peer 880bb7f4673e455a81357bcc53362d19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:56:24.522097 19319 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:24.522217 19319 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:24.522272 19319 tablet_replica.cc:330] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: stopping tablet replica
I20260620 14:56:24.535794 19319 master.cc:552] Master@127.12.116.189:41665 shutdown complete.
I20260620 14:56:24.535867 19319 master_runner.cc:305] Clearing existing system tablet
I20260620 14:56:24.536001 19319 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.536055 19319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.536929 19319 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:24.537935 19419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.538213 19319 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.538285 19319 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:24.538318 19319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
uuid: "880bb7f4673e455a81357bcc53362d19"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "4bf9f4cd20f905ea39f519d61affafc6"
server_key_iv: "715d9529b5f8416593a0fbebeb46cb45"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.539374 19319 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:24.541242 19319 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260620 14:56:24.541322 19319 log.cc:1196] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260620 14:56:24.541544 19319 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Deleting consensus metadata
I20260620 14:56:24.542052 19319 master_runner.cc:315] Copying system tablet from 127.12.116.190:38675
I20260620 14:56:24.542800 19319 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: tablet copy: Beginning tablet copy session from remote peer at address 127.12.116.190:38675
I20260620 14:56:24.551723 19425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.543209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:54894)
0620 14:56:24.543576 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.543589 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.543661 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.543838 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.543839 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.544022 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.544084 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.544086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.545224 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.545225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.545908 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.545910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.546534 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.546535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.546725 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.547371 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.547378 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.547830 (+ 452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.550021 (+ 2191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.550022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.550023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.550283 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.550561 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.550562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.550562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.550641 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.551256 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.551257 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.551323 (+ 66us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.551419 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.551549 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":137,"threads_started":1}
I20260620 14:56:24.551781 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.543484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.12.116.190:38675)
0620 14:56:24.543571 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.543573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.543644 (+ 71us) server_negotiation.cc:407] Connection header received
0620 14:56:24.543727 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.543728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.543742 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.543805 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.544168 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.545054 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.546016 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.546356 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.546441 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.547997 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.547998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.547999 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.548009 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.549880 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.550370 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.550372 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.550372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.550459 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.550806 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.550813 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.550813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.551111 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.551257 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.551496 (+ 239us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.551643 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260620 14:56:24.552233 18875 tablet_copy_service.cc:140] P 836ae634df5a4cda8f288bbd35d30a5a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 880bb7f4673e455a81357bcc53362d19 ({username='oryx', principal='oryx/127.12.116.189@KRBTEST.COM'} at 127.0.0.1:54894)
I20260620 14:56:24.552438 18875 tablet_copy_service.cc:161] P 836ae634df5a4cda8f288bbd35d30a5a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 880bb7f4673e455a81357bcc53362d19 at {username='oryx', principal='oryx/127.12.116.189@KRBTEST.COM'} at 127.0.0.1:54894: session id = 880bb7f4673e455a81357bcc53362d19-00000000000000000000000000000000
I20260620 14:56:24.553457 18875 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 14:56:24.554188 19319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260620 14:56:24.555338 19319 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: tablet copy: Starting download of 0 data blocks...
I20260620 14:56:24.555537 19319 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: tablet copy: Starting download of 1 WAL segments...
I20260620 14:56:24.557112 19319 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 14:56:24.558316 18875 tablet_copy_service.cc:342] P 836ae634df5a4cda8f288bbd35d30a5a: Request end of tablet copy session 880bb7f4673e455a81357bcc53362d19-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.116.189@KRBTEST.COM'} at 127.0.0.1:54894
I20260620 14:56:24.558405 18875 tablet_copy_service.cc:433] P 836ae634df5a4cda8f288bbd35d30a5a: ending tablet copy session 880bb7f4673e455a81357bcc53362d19-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 880bb7f4673e455a81357bcc53362d19
I20260620 14:56:24.562798 19319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:24.564409 19427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.564496 19426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.564519 19429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:24.568702 19319 server_base.cc:1034] running on GCE node
I20260620 14:56:24.568907 19319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:24.569116 19319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:24.570250 19319 hybrid_clock.cc:648] HybridClock initialized: now 1781967384570244 us; error 37 us; skew 500 ppm
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:24.572062 19319 init.cc:377] Logged in from keytab as oryx/127.12.116.189@KRBTEST.COM (short username oryx)
I20260620 14:56:24.572431 19319 webserver.cc:460] Webserver started at http://127.12.116.189:40695/ using document root <none> and password file <none>
I20260620 14:56:24.572564 19319 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.572603 19319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.573457 19319 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:24.574023 19436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.574193 19319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.574261 19319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
uuid: "880bb7f4673e455a81357bcc53362d19"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "4bf9f4cd20f905ea39f519d61affafc6"
server_key_iv: "715d9529b5f8416593a0fbebeb46cb45"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.574337 19319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.593647 19319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:24.596536 19319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:24.601020 19319 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.189:41665
I20260620 14:56:24.601022 19488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.189:41665 every 8 connection(s)
I20260620 14:56:24.601892 19319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
I20260620 14:56:24.602962 19489 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:56:24.603595 19489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Bootstrap starting.
I20260620 14:56:24.606935 19489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:56:24.607424 19489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Bootstrap complete.
I20260620 14:56:24.607848 19489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } }
I20260620 14:56:24.608119 19489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 880bb7f4673e455a81357bcc53362d19, State: Initialized, Role: LEARNER
I20260620 14:56:24.608186 19489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } }
I20260620 14:56:24.608505 19489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:24.608492 19492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } }
I20260620 14:56:24.608834 19492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: LEARNER
I20260620 14:56:24.610766 19503 catalog_manager.cc:1259] Loaded cluster ID: 9dcfdfef212f43ada712c31ae0149293
I20260620 14:56:24.610855 19503 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: loading cluster ID for follower catalog manager: success
I20260620 14:56:24.612035 19503 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: acquiring CA information for follower catalog manager: success
I20260620 14:56:24.612519 19503 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:56:24.637774 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.628890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54018 (local address 127.12.116.189:41665)
0620 14:56:24.629098 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.629100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.629107 (+ 7us) server_negotiation.cc:407] Connection header received
0620 14:56:24.629133 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.629133 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.629143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.629226 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.630226 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.630950 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.632075 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.632444 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.632532 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.634057 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.634059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.634060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.634067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.636266 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.636806 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.636808 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.636808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.636880 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.637116 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.637117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.637118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.637258 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.637382 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.637502 (+ 120us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.637609 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for oryx/127.12.116.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.188.keytab.
Entry for principal oryx/127.12.116.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.188.keytab.
I20260620 14:56:24.672012 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:41453
--webserver_interface=127.12.116.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.188.keytab
--principal=oryx/127.12.116.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:24.762909 19507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:24.763168 19507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:24.763196 19507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:24.764662 19507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:24.764737 19507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:24.764753 19507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:24.764766 19507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:24.764779 19507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:24.766610 19507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.188.keytab
--principal=oryx/127.12.116.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:41453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.116.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:24.766955 19507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:24.767252 19507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:24.773355 19512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.773344 19513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.773344 19515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:24.773859 19507 server_base.cc:1034] running on GCE node
I20260620 14:56:24.774137 19507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:24.774528 19507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:24.775766 19507 hybrid_clock.cc:648] HybridClock initialized: now 1781967384775739 us; error 56 us; skew 500 ppm
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:24.779250 19507 init.cc:377] Logged in from keytab as oryx/127.12.116.188@KRBTEST.COM (short username oryx)
I20260620 14:56:24.779893 19507 webserver.cc:460] Webserver started at http://127.12.116.188:46701/ using document root <none> and password file <none>
I20260620 14:56:24.780189 19507 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.780241 19507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.780418 19507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:24.781680 19507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/instance:
uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "57e5b96dcd7b711e383b4512a82a7964"
server_key_iv: "d9f98a9498e582fc92b5a4cadb35d0e5"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.782060 19507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal/instance:
uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "57e5b96dcd7b711e383b4512a82a7964"
server_key_iv: "d9f98a9498e582fc92b5a4cadb35d0e5"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.783733 19507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 14:56:24.784839 19522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.785053 19507 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:24.785153 19507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "57e5b96dcd7b711e383b4512a82a7964"
server_key_iv: "d9f98a9498e582fc92b5a4cadb35d0e5"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.785221 19507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.812465 19507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:24.815605 19507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:24.815769 19507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:24.824103 19507 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.188:41453
I20260620 14:56:24.824128 19574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.188:41453 every 8 connection(s)
I20260620 14:56:24.824703 19507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
I20260620 14:56:24.825863 19575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:24.827535 19575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:56:24.828522 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19507
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.188@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.116.188@KRBTEST.COM
I20260620 14:56:24.840736 19046 heartbeater.cc:503] Master 127.12.116.190:38675 was elected leader, sending a full tablet report...
I20260620 14:56:24.841156 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.828521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54900 (local address 127.12.116.190:38675)
0620 14:56:24.828578 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.828581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.828949 (+ 368us) server_negotiation.cc:407] Connection header received
0620 14:56:24.829785 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.829786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.829801 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.829888 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.830957 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.831857 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.833521 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.833992 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.834112 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.837231 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.837233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.837234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.837245 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.838964 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.839637 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.839639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.839640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.839808 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.840178 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.840180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.840181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.840447 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.840632 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.840966 (+ 334us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.841088 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 14:56:24.841823 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.828303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:54900)
0620 14:56:24.828700 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.828806 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.829661 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.829978 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.829981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.830414 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.830754 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.830761 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.832065 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.832066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.833404 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.833408 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.834202 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.834203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.834322 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.835130 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.835141 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.837107 (+ 1966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.839060 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.839066 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.839069 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.839415 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.839944 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.839944 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.839945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.840070 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.840530 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.840537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.840765 (+ 228us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.841343 (+ 578us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.841563 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":192,"threads_started":1}
I20260620 14:56:24.841823 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.829205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41136 (local address 127.12.116.188:41453)
0620 14:56:24.829397 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.829401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.829430 (+ 29us) server_negotiation.cc:407] Connection header received
0620 14:56:24.829785 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.829792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.829823 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.829921 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.830890 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.832290 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.833489 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.834179 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.834298 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.837726 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.837735 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.837736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.837744 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.839711 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.840406 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.840413 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.840419 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.840510 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.840905 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.840906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.840906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.841119 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.841316 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.841567 (+ 251us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.841638 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":105,"threads_started":1}
I20260620 14:56:24.842525 19575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.188@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
I20260620 14:56:24.851964 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.842861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:54028)
0620 14:56:24.842950 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.842962 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.843045 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.843216 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.843217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.843376 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.843417 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.843418 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.844164 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.844165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.844803 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.844805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.845195 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.845196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.845253 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.845692 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.845697 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.847636 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.850115 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.850117 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.850118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.850337 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.851086 (+ 749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.851087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.851087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.851164 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.851604 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.851605 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.851701 (+ 96us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.851776 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.851881 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260620 14:56:24.852221 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.843027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54028 (local address 127.12.116.189:41665)
0620 14:56:24.843085 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.843087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.843095 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:24.843126 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.843126 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.843144 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.843212 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.843499 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.844090 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.844897 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.845103 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.845187 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.847837 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.847841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.847841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.847859 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.849815 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.850830 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.850833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.850833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.850944 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.851295 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.851297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.851297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.851455 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.851554 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.851874 (+ 320us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.852029 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 14:56:24.852876 19575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.188@KRBTEST.COM for oryx/127.12.116.188@KRBTEST.COM
I20260620 14:56:24.861107 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.853452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41142 (local address 127.12.116.188:41453)
0620 14:56:24.853538 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.853539 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.853548 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:24.853793 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.853794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.853816 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.854050 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.854390 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.854943 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.855735 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.855989 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.856081 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.858190 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.858191 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.858192 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.858200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.859739 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.860156 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.860157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.860157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.860216 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.860477 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.860478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.860478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.860604 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.860683 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.860823 (+ 140us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.860965 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":69}
I20260620 14:56:24.861114 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.853410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41142)
0620 14:56:24.853454 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.853467 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.853534 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.854057 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.854058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.854255 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.854295 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.854298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.855071 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.855072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.855559 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.855561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.856080 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.856081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.856138 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.856707 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.856711 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.858075 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.859893 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.859894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.859895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.860066 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.860291 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.860291 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.860292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.860403 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.860672 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.860673 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.860712 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.860800 (+ 88us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.861017 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":94}
I20260620 14:56:24.863123 19575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Bootstrap starting.
I20260620 14:56:24.863955 19575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:24.864192 19575 log.cc:824] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:24.865087 19575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: No bootstrap required, opened a new log
I20260620 14:56:24.867100 19575 raft_consensus.cc:348] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } }
I20260620 14:56:24.867331 19575 raft_consensus.cc:374] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:24.867357 19575 raft_consensus.cc:729] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e50cd77ce09a4ba7b5688b5db1bb7688, State: Initialized, Role: FOLLOWER
I20260620 14:56:24.867554 19575 consensus_queue.cc:260] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } }
I20260620 14:56:24.868214 19575 sys_catalog.cc:564] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:24.868144 19580 sys_catalog.cc:455] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } } }
I20260620 14:56:24.868300 19580 sys_catalog.cc:458] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: This master's current role is: FOLLOWER
W20260620 14:56:24.870271 19591 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:56:24.870416 19591 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:56:24.874434 19507 master_runner.cc:428] Detected that this master e50cd77ce09a4ba7b5688b5db1bb7688 is joining an existing cluster
I20260620 14:56:24.874547 19507 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.116.188:41453
I20260620 14:56:24.893636 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18917
I20260620 14:56:24.898850 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:33625
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:38675
--webserver_port=38075
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:56:24.905745 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.875770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54042 (local address 127.12.116.189:41665)
0620 14:56:24.875813 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.875815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.876001 (+ 186us) server_negotiation.cc:407] Connection header received
0620 14:56:24.876095 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.876096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.876107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.876145 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.876689 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.877476 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.878702 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.879005 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.879047 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.901962 (+ 22915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.901964 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.901965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.901975 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.903756 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.904713 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.904714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.904715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.904788 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.905004 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.905005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.905006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.905186 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.905248 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.905488 (+ 240us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.905590 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:24.906035 19598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.875586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:54914)
0620 14:56:24.875809 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.875822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.875885 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.876094 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.876094 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.876482 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.876575 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.876579 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.877578 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.877579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.878591 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.878594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.879129 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.879130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.879197 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.900975 (+ 21778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.900982 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.901481 (+ 499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.904937 (+ 3456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.904938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.904938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.905153 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.905370 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.905370 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.905371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.905423 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.905698 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.905699 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.905740 (+ 41us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.905804 (+ 64us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.905918 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":51,"thread_start_us":88,"threads_started":1}
I20260620 14:56:24.906421 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.875677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54914 (local address 127.12.116.190:38675)
0620 14:56:24.875731 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.875733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.875870 (+ 137us) server_negotiation.cc:407] Connection header received
0620 14:56:24.875974 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.875975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.875987 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.876020 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.876689 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.877477 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.878710 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.879009 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.879047 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.901629 (+ 22582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.901631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.901631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.901640 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.904828 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.905244 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.905245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.905245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.905301 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.905486 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.905487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.905487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.905617 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.905675 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.906248 (+ 573us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.906332 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 14:56:24.906965 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.875647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:54042)
0620 14:56:24.875945 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.875954 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.876023 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.876214 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.876214 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.876549 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.876603 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.876604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.877578 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.877579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.878599 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.878600 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.879130 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.879131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.879972 (+ 841us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.880802 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.880806 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.901819 (+ 21013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.903881 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.903882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.903882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.904616 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.904866 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.904866 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.904867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.904931 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.905286 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.905287 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.905358 (+ 71us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.906674 (+ 1316us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.906811 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":42,"thread_start_us":86,"threads_started":1}
I20260620 14:56:24.909075 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.875966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41152 (local address 127.12.116.188:41453)
0620 14:56:24.876003 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.876006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.876113 (+ 107us) server_negotiation.cc:407] Connection header received
0620 14:56:24.876199 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.876200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.876208 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.876234 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.876761 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.877468 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.878536 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.878824 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.878869 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.880169 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.880170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.880170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.880177 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.904316 (+ 24139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.908248 (+ 3932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.908249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.908250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.908297 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.908590 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.908591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.908591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.908704 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.908741 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.908910 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.908989 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 14:56:24.909891 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.875830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41152)
0620 14:56:24.876046 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.876055 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.876135 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.876289 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.876289 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.876607 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.876671 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.876674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.877564 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.877565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.878434 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.878438 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.878958 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.878959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.879017 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.879506 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.879512 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.880043 (+ 531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.907938 (+ 27895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.907939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.907940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.908153 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.908474 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.908475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.908475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.908527 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.908780 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.908781 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.908815 (+ 34us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.909684 (+ 869us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.909784 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":69,"threads_started":1}
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967383, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.190@KRBTEST.COM for oryx/127.12.116.188@KRBTEST.COM
I20260620 14:56:24.917546 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.908850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41162)
0620 14:56:24.908970 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.908982 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.909024 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.909390 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.909391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.909555 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.909607 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.909609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.910625 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.910626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.911617 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.911620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.912137 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.912139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.912239 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.912768 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.912773 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.914284 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.916399 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.916400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.916401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.916630 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.916851 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.916852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.916852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.916916 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.917196 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.917197 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.917249 (+ 52us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.917319 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.917437 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260620 14:56:24.917542 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.909167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41162 (local address 127.12.116.188:41453)
0620 14:56:24.909237 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.909238 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.909245 (+ 7us) server_negotiation.cc:407] Connection header received
0620 14:56:24.909276 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.909277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.909286 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.909338 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.909701 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.910516 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.911734 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.912038 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.912114 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.914383 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.914385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.914385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.914394 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.916228 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.916712 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.916714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.916714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.916778 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.916983 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.916983 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.916984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.917127 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.917199 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.917360 (+ 161us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.917441 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":45}
I20260620 14:56:24.918895 18855 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.116.188:41453: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
member_type: NON_VOTER
last_known_addr {
host: "127.12.116.188"
port: 41453
}
attrs {
promote: true
}
}
dest_uuid: "836ae634df5a4cda8f288bbd35d30a5a"
cas_config_opid_index: 5
I20260620 14:56:24.919224 18855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } }
I20260620 14:56:24.919667 19414 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.920730 19414 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.116.188:41453
I20260620 14:56:24.920708 19549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:24.920812 19414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.920876 19414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:24.921428 19507 master.cc:537] Master@127.12.116.188:41453 shutting down...
I20260620 14:56:24.921732 19549 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Refusing update from remote peer 836ae634df5a4cda8f288bbd35d30a5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260620 14:56:24.922029 19415 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:56:24.922915 18841 consensus_peers.cc:487] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a -> Peer e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188:41453): Couldn't send request to peer e50cd77ce09a4ba7b5688b5db1bb7688. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:56:24.924399 19507 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:24.924506 19507 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:24.924553 19507 tablet_replica.cc:330] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: stopping tablet replica
I20260620 14:56:24.927584 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.919737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:54054)
0620 14:56:24.920017 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.920030 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.920069 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.923206 (+ 3137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.923208 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.923210 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:24.923512 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.923516 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.924807 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.924809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.926371 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.926375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.927286 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.927288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.927361 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.927391 (+ 30us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.927443 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.927495 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262}
I20260620 14:56:24.927999 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.919841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54054 (local address 127.12.116.189:41665)
0620 14:56:24.923025 (+ 3184us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.923028 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.923040 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:24.923066 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.923067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.923091 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.923161 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:24.923623 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.924557 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.926492 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.927108 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.927185 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.927246 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.927879 (+ 633us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.927930 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3149}
I20260620 14:56:24.928653 19463 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 LEARNER]: Refusing update from remote peer 836ae634df5a4cda8f288bbd35d30a5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260620 14:56:24.928894 19415 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 14:56:24.929538 19463 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.930778 19492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 836ae634df5a4cda8f288bbd35d30a5a. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.930860 19492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: LEARNER
I20260620 14:56:24.930892 19492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: NON_VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: true } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.930927 19492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: LEARNER
I20260620 14:56:24.931224 19415 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: attempting to promote NON_VOTER 880bb7f4673e455a81357bcc53362d19 to VOTER
I20260620 14:56:24.931468 19415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } }
I20260620 14:56:24.932125 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.931965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41168)
0620 14:56:24.932026 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.932087 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:41453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 14:56:24.932164 19463 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 LEARNER]: Refusing update from remote peer 836ae634df5a4cda8f288bbd35d30a5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260620 14:56:24.932386 19414 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 14:56:24.932646 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.932524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41182)
0620 14:56:24.932600 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.932624 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:41453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260620 14:56:24.932773 18841 consensus_peers.cc:487] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a -> Peer e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188:41453): Couldn't send request to peer e50cd77ce09a4ba7b5688b5db1bb7688. Status: Network error: Client connection negotiation failed: client connection to 127.12.116.188:41453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:56:24.933140 19603 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 880bb7f4673e455a81357bcc53362d19 (127.12.116.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.933213 19463 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 880bb7f4673e455a81357bcc53362d19 (127.12.116.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.934333 19602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.934477 19602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:56:24.934773 19414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.934867 19414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:24.934948 19603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.935003 19603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:24.938028 19507 master.cc:552] Master@127.12.116.188:41453 shutdown complete.
I20260620 14:56:24.938098 19507 master_runner.cc:305] Clearing existing system tablet
I20260620 14:56:24.938249 19507 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.938301 19507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.939102 19507 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260620 14:56:24.939721 19606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.939934 19507 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.940001 19507 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:24.940026 19507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "57e5b96dcd7b711e383b4512a82a7964"
server_key_iv: "d9f98a9498e582fc92b5a4cadb35d0e5"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.940985 19507 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:24.942938 19507 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260620 14:56:24.943041 19507 log.cc:1196] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260620 14:56:24.943272 19507 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Deleting consensus metadata
I20260620 14:56:24.943406 19507 master_runner.cc:315] Copying system tablet from 127.12.116.190:38675
I20260620 14:56:24.944111 19507 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: tablet copy: Beginning tablet copy session from remote peer at address 127.12.116.190:38675
I20260620 14:56:24.952227 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.944611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54924 (local address 127.12.116.190:38675)
0620 14:56:24.944664 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:24.944667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:24.944745 (+ 78us) server_negotiation.cc:407] Connection header received
0620 14:56:24.944823 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:24.944824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:24.944837 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:24.944921 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:24.945377 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.946147 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.947230 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.947535 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.947614 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.948898 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:24.948899 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:24.948899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:24.948908 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:24.950777 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.951234 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.951235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.951236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.951301 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:24.951516 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:24.951517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:24.951517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:24.951663 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:24.951758 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:24.952031 (+ 273us) server_negotiation.cc:299] Negotiation successful
0620 14:56:24.952121 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:56:24.952243 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:24.944528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:54924)
0620 14:56:24.944671 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:24.944682 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:24.944760 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:24.944979 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:24.944980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:24.945195 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:24.945277 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.945279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.946264 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.946266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.947128 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:24.947131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:24.947626 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:24.947627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:24.947705 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:24.948282 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:24.948287 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:24.948791 (+ 504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:24.950892 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.950893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.950894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.951138 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.951378 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:24.951378 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:24.951379 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:24.951448 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:24.951770 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:24.951771 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:24.951841 (+ 70us) client_negotiation.cc:769] Sending connection context
0620 14:56:24.951981 (+ 140us) client_negotiation.cc:240] Negotiation successful
0620 14:56:24.952122 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":75,"threads_started":1}
I20260620 14:56:24.952941 18875 tablet_copy_service.cc:140] P 836ae634df5a4cda8f288bbd35d30a5a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e50cd77ce09a4ba7b5688b5db1bb7688 ({username='oryx', principal='oryx/127.12.116.188@KRBTEST.COM'} at 127.0.0.1:54924)
I20260620 14:56:24.953014 18875 tablet_copy_service.cc:161] P 836ae634df5a4cda8f288bbd35d30a5a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e50cd77ce09a4ba7b5688b5db1bb7688 at {username='oryx', principal='oryx/127.12.116.188@KRBTEST.COM'} at 127.0.0.1:54924: session id = e50cd77ce09a4ba7b5688b5db1bb7688-00000000000000000000000000000000
I20260620 14:56:24.953662 18875 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 14:56:24.954231 19507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260620 14:56:24.955760 19507 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: tablet copy: Starting download of 0 data blocks...
I20260620 14:56:24.955941 19507 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: tablet copy: Starting download of 1 WAL segments...
I20260620 14:56:24.956979 19507 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 14:56:24.958076 18875 tablet_copy_service.cc:342] P 836ae634df5a4cda8f288bbd35d30a5a: Request end of tablet copy session e50cd77ce09a4ba7b5688b5db1bb7688-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.116.188@KRBTEST.COM'} at 127.0.0.1:54924
I20260620 14:56:24.958153 18875 tablet_copy_service.cc:433] P 836ae634df5a4cda8f288bbd35d30a5a: ending tablet copy session e50cd77ce09a4ba7b5688b5db1bb7688-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e50cd77ce09a4ba7b5688b5db1bb7688
I20260620 14:56:24.961194 19507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:24.962600 19613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:24.962961 19614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:24.965701 19507 server_base.cc:1034] running on GCE node
W20260620 14:56:24.965899 19616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:24.966063 19507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:24.966271 19507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:24.967432 19507 hybrid_clock.cc:648] HybridClock initialized: now 1781967384967423 us; error 31 us; skew 500 ppm
Jun 20 14:56:24 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967384, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:24.969209 19507 init.cc:377] Logged in from keytab as oryx/127.12.116.188@KRBTEST.COM (short username oryx)
I20260620 14:56:24.969511 19507 webserver.cc:460] Webserver started at http://127.12.116.188:36771/ using document root <none> and password file <none>
I20260620 14:56:24.969638 19507 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:24.969667 19507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:24.970441 19507 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:24.971088 19623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:24.971211 19507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 14:56:24.971256 19507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "57e5b96dcd7b711e383b4512a82a7964"
server_key_iv: "d9f98a9498e582fc92b5a4cadb35d0e5"
server_key_version: "encryptionkey@0"
I20260620 14:56:24.971323 19507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:24.977221 19507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:24.979212 19507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:24.982460 19507 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.188:41453
I20260620 14:56:24.982865 19507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
I20260620 14:56:24.984534 19675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.188:41453 every 8 connection(s)
I20260620 14:56:24.985405 19676 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:56:24.986009 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Bootstrap starting.
I20260620 14:56:24.990257 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:56:24.990546 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: Bootstrap complete.
I20260620 14:56:24.990760 19676 raft_consensus.cc:348] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } }
I20260620 14:56:24.990842 19676 raft_consensus.cc:729] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e50cd77ce09a4ba7b5688b5db1bb7688, State: Initialized, Role: LEARNER
I20260620 14:56:24.990876 19676 consensus_queue.cc:260] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } }
I20260620 14:56:24.991081 19676 sys_catalog.cc:564] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:24.991106 19679 sys_catalog.cc:455] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:24.991223 19679 sys_catalog.cc:458] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: This master's current role is: LEARNER
I20260620 14:56:24.993729 19690 catalog_manager.cc:1259] Loaded cluster ID: 9dcfdfef212f43ada712c31ae0149293
I20260620 14:56:24.993795 19690 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: loading cluster ID for follower catalog manager: success
I20260620 14:56:24.994923 19690 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: acquiring CA information for follower catalog manager: success
I20260620 14:56:24.995244 19690 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260620 14:56:25.017334 19600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:25.017622 19600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:25.017665 19600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:25.019066 19600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:25.019169 19600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:25.019224 19600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:25.022204 19600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:33625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=38075
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:25.022915 19600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:25.023367 19600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:56:25.030563 19600 server_base.cc:1034] running on GCE node
W20260620 14:56:25.030505 19695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:25.030525 19696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:25.031212 19698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:25.031477 19600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:25.031849 19600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:25.033042 19600 hybrid_clock.cc:648] HybridClock initialized: now 1781967385032997 us; error 62 us; skew 500 ppm
I20260620 14:56:25.034823 19180 heartbeater.cc:503] Master 127.12.116.190:38675 was elected leader, sending a full tablet report...
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:25.036809 19600 init.cc:377] Logged in from keytab as oryx/127.12.116.129@KRBTEST.COM (short username oryx)
I20260620 14:56:25.037725 19600 webserver.cc:460] Webserver started at http://127.12.116.129:38075/ using document root <none> and password file <none>
I20260620 14:56:25.038090 19600 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:25.038173 19600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:25.040158 19600 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260620 14:56:25.040977 19705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.041157 19600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:25.041286 19600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "4aef9f1a940044f6b939273112044613"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "89d7def08dd030a9b4fc150698503a0d"
server_key_iv: "07859d0be130cea9165f0cc79543de11"
server_key_version: "encryptionkey@0"
I20260620 14:56:25.041726 19600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:25.061542 19600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:25.064580 19600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:25.064765 19600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:25.065059 19600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:25.065431 19600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:25.065495 19600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.065544 19600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:25.065590 19600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.073745 19600 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:33625
I20260620 14:56:25.073812 19818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:33625 every 8 connection(s)
I20260620 14:56:25.074290 19600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:25.078397 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19600
I20260620 14:56:25.078595 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19051
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.188@KRBTEST.COM
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
I20260620 14:56:25.085258 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:36227
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:38675
--webserver_port=43063
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:25.090571 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.075165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:57041 (local address 127.12.116.189:41665)
0620 14:56:25.075222 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.075224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.075547 (+ 323us) server_negotiation.cc:407] Connection header received
0620 14:56:25.076183 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.076184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.076197 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.076257 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.077336 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.078135 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.080107 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.080405 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.080479 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.086220 (+ 5741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.086222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.086222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.086232 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.088418 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089207 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.089209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.089210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.089284 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089634 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.089634 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.089635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.089824 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.089872 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.090332 (+ 460us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.090435 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:56:25.090802 19826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.075193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.12.116.129:51907)
0620 14:56:25.075678 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.075690 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.076106 (+ 416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.076466 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.076467 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.076994 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.077222 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.077227 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.078136 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.078137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.080743 (+ 2606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.080747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.081307 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.081309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.081489 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.082228 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.082239 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.085421 (+ 3182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.088623 (+ 3202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.088624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.088625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.089101 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.089543 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.089544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.089659 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.089994 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.089995 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.090148 (+ 153us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.090259 (+ 111us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.090490 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":89,"thread_start_us":75,"threads_started":1}
I20260620 14:56:25.090932 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.075630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:46215 (local address 127.12.116.190:38675)
0620 14:56:25.075696 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.075698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.076606 (+ 908us) server_negotiation.cc:407] Connection header received
0620 14:56:25.076640 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.076641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.076653 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.076721 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.077335 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.078132 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.081703 (+ 3571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.082570 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.082650 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.086284 (+ 3634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.086286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.086287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.086296 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.089227 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089983 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.089984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.089984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.090049 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.090257 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.090258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.090258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.090390 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.090447 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.090704 (+ 257us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.090830 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 14:56:25.091374 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.075228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:51907 (local address 127.12.116.188:41453)
0620 14:56:25.075337 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.075340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.075758 (+ 418us) server_negotiation.cc:407] Connection header received
0620 14:56:25.076313 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.076314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.076352 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.076447 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.077327 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.078010 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.080859 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.081193 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.081278 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.085580 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.085582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.085583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.085593 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.088313 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089221 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.089223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.089223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.089430 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089745 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.089746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.089746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.089909 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.091110 (+ 1201us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.091160 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.091270 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":59,"threads_started":1}
I20260620 14:56:25.091390 19824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.075561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:46215)
0620 14:56:25.076514 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.076525 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.076588 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.076725 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.076726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.076994 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.077223 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.077228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.080920 (+ 3692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.080921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.081593 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.081595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.082713 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.082714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.082777 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.083227 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.083232 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.086105 (+ 2873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.089634 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089634 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.089635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.089883 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.090120 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.090120 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.090121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.090180 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.090484 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.090485 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.090522 (+ 37us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.091075 (+ 553us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.091256 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":939,"mutex_wait_us":2,"thread_start_us":69,"threads_started":1}
I20260620 14:56:25.091809 19819 heartbeater.cc:347] Connected to a master server at 127.12.116.188:41453
I20260620 14:56:25.091817 19820 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38675
I20260620 14:56:25.091974 19820 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.091974 19819 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.092242 19820 heartbeater.cc:511] Master 127.12.116.190:38675 requested a full tablet report, sending...
I20260620 14:56:25.092242 19819 heartbeater.cc:511] Master 127.12.116.188:41453 requested a full tablet report, sending...
I20260620 14:56:25.092638 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.075193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.12.116.129:57041)
0620 14:56:25.075401 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.075449 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.076056 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.076422 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.076429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.076995 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.077223 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.077228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.078233 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.078234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.079974 (+ 1740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.079979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.081719 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.081720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.081800 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.082327 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.082333 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.086103 (+ 3770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.088542 (+ 2439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.088556 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.088559 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.089101 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.089361 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.089362 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.089362 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.089534 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.089923 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.089931 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.090147 (+ 216us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.091765 (+ 1618us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.091904 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":48,"thread_start_us":100,"threads_started":1}
I20260620 14:56:25.092795 18855 ts_manager.cc:194] Re-registered known tserver with Master: 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625)
I20260620 14:56:25.092893 19640 ts_manager.cc:194] Registered new tserver with Master: 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625)
I20260620 14:56:25.093343 18855 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:46215
I20260620 14:56:25.093441 19821 heartbeater.cc:347] Connected to a master server at 127.12.116.189:41665
I20260620 14:56:25.093492 19821 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.093580 19821 heartbeater.cc:511] Master 127.12.116.189:41665 requested a full tablet report, sending...
I20260620 14:56:25.093994 19453 ts_manager.cc:194] Registered new tserver with Master: 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625)
W20260620 14:56:25.189182 19827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:25.189482 19827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:25.189525 19827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:25.190955 19827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:25.191036 19827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:25.191088 19827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:25.193236 19827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:36227
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=43063
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:25.193617 19827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:25.194000 19827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:25.199846 19832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:25.199844 19835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:25.200047 19827 server_base.cc:1034] running on GCE node
W20260620 14:56:25.199837 19833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:25.200773 19827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:25.201164 19827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:25.202478 19827 hybrid_clock.cc:648] HybridClock initialized: now 1781967385202453 us; error 67 us; skew 500 ppm
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:25.206123 19827 init.cc:377] Logged in from keytab as oryx/127.12.116.130@KRBTEST.COM (short username oryx)
I20260620 14:56:25.206707 19827 webserver.cc:460] Webserver started at http://127.12.116.130:43063/ using document root <none> and password file <none>
I20260620 14:56:25.207062 19827 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:25.207163 19827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:25.209281 19827 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:56:25.210462 19842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.210896 19827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:25.211040 19827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "c9085e544cd1446aa4c35c86d1a37219"
format_stamp: "Formatted at 2026-06-20 14:56:23 on dist-test-slave-7v06"
server_key: "ec92db7320e746e966252f5cebf9ae2b"
server_key_iv: "c0e944671f7f7c688cc419908c827ded"
server_key_version: "encryptionkey@0"
I20260620 14:56:25.211493 19827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:25.222288 19827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:25.225050 19827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:25.225261 19827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:25.225565 19827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:25.225956 19827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:25.226027 19827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.226070 19827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:25.226122 19827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.235298 19827 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:36227
I20260620 14:56:25.235380 19955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:36227 every 8 connection(s)
I20260620 14:56:25.235994 19827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:25.244007 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19827
I20260620 14:56:25.244210 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19185
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.188@KRBTEST.COM
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
I20260620 14:56:25.251390 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:43267
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:38675
--webserver_port=41185
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:56:25.255263 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.237650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:39715 (local address 127.12.116.190:38675)
0620 14:56:25.238023 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.238025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.239266 (+ 1241us) server_negotiation.cc:407] Connection header received
0620 14:56:25.239299 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.239301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.239313 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.239376 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.240391 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.241433 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.245668 (+ 4235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.246037 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.246119 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.251756 (+ 5637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.251758 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.251759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.251769 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.253730 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.254189 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.254190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.254191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.254256 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.254464 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.254465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.254466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.254643 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.254711 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.255060 (+ 349us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.255157 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334}
I20260620 14:56:25.255278 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.237027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:41301 (local address 127.12.116.188:41453)
0620 14:56:25.237457 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.237460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.238003 (+ 543us) server_negotiation.cc:407] Connection header received
0620 14:56:25.239062 (+ 1059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.239063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.239079 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.239288 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.240286 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.241417 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.244040 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.244405 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.244453 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.250911 (+ 6458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.250914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.250915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.250926 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.253330 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.253992 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.253994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.253995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.254061 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.254412 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.254413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.254414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.254563 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.254641 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.255058 (+ 417us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.255159 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399}
I20260620 14:56:25.256364 19961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.237056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.12.116.130:41301)
0620 14:56:25.237692 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.237748 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.238885 (+ 1137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.239391 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.239396 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.239884 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.240158 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.240165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.241967 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.241968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.243540 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.243548 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.245978 (+ 2430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.245979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.246258 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.247339 (+ 1081us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.247348 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.250719 (+ 3371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.253449 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.253465 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.253469 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.253892 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.254171 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.254172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.254172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.254347 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.254646 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.254654 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.254870 (+ 216us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.255431 (+ 561us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.256020 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":18,"thread_start_us":204,"threads_started":1}
I20260620 14:56:25.256450 19960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.237066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:39715)
0620 14:56:25.239090 (+ 2024us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.239100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.239184 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.239404 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.239405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.239921 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.240158 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.240164 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.241663 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.241664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.243932 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.243939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.246320 (+ 2381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.246321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.246414 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.247266 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.247278 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.251247 (+ 3969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.253846 (+ 2599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.253847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.253848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.254123 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.254334 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.254335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.254336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.254402 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.254708 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.254708 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.254870 (+ 162us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.255431 (+ 561us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.256287 (+ 856us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1994,"mutex_wait_us":796,"thread_start_us":176,"threads_started":1}
I20260620 14:56:25.256687 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.237194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:37263 (local address 127.12.116.189:41665)
0620 14:56:25.237268 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.237271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.239330 (+ 2059us) server_negotiation.cc:407] Connection header received
0620 14:56:25.239428 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.239430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.239444 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.239478 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.240287 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.240877 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.244041 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.246649 (+ 2608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.246770 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.251731 (+ 4961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.251734 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.251734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.251761 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.254394 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.255102 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.255103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.255103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.255186 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.255970 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.255971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.255972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.256128 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.256201 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.256452 (+ 251us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.256553 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 14:56:25.256927 19956 heartbeater.cc:347] Connected to a master server at 127.12.116.188:41453
I20260620 14:56:25.257027 19956 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.257210 19956 heartbeater.cc:511] Master 127.12.116.188:41453 requested a full tablet report, sending...
I20260620 14:56:25.257505 19957 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38675
I20260620 14:56:25.257562 19957 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.257640 19957 heartbeater.cc:511] Master 127.12.116.190:38675 requested a full tablet report, sending...
I20260620 14:56:25.257737 19640 ts_manager.cc:194] Registered new tserver with Master: c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227)
I20260620 14:56:25.257941 18855 ts_manager.cc:194] Re-registered known tserver with Master: c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227)
I20260620 14:56:25.258242 19962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.237066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.12.116.130:37263)
0620 14:56:25.239268 (+ 2202us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.239277 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.239355 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.239548 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.239549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.239938 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.240158 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.240165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.241406 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.241411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.243540 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.243548 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.246772 (+ 3224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.246773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.247150 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.247935 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.247942 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.251617 (+ 3675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.254748 (+ 3131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.254749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.254750 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.255000 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.255266 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.255266 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.255267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.255842 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.256230 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.256231 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.256286 (+ 55us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.257827 (+ 1541us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.257981 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2169,"mutex_wait_us":204,"thread_start_us":105,"threads_started":1}
I20260620 14:56:25.258483 18855 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:39715
I20260620 14:56:25.258618 19958 heartbeater.cc:347] Connected to a master server at 127.12.116.189:41665
I20260620 14:56:25.258679 19958 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.258759 19958 heartbeater.cc:511] Master 127.12.116.189:41665 requested a full tablet report, sending...
I20260620 14:56:25.259156 19453 ts_manager.cc:194] Registered new tserver with Master: c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227)
W20260620 14:56:25.346551 19963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:25.346832 19963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:25.346874 19963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:25.348227 19963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:25.348301 19963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:25.348378 19963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:25.350050 19963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:43267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=41185
--tserver_master_addrs=127.12.116.190:38675,127.12.116.189:41665,127.12.116.188:41453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:25.350361 19963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:25.350620 19963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:25.356487 19969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:25.356665 19971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:25.356818 19963 server_base.cc:1034] running on GCE node
W20260620 14:56:25.356858 19968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:25.357129 19963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:25.357471 19963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:25.358671 19963 hybrid_clock.cc:648] HybridClock initialized: now 1781967385358635 us; error 47 us; skew 500 ppm
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:25.361974 19963 init.cc:377] Logged in from keytab as oryx/127.12.116.131@KRBTEST.COM (short username oryx)
I20260620 14:56:25.362562 19963 webserver.cc:460] Webserver started at http://127.12.116.131:41185/ using document root <none> and password file <none>
I20260620 14:56:25.362828 19963 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:25.362924 19963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:25.364481 19963 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:56:25.365156 19978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.365386 19963 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:25.365499 19963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "769d010c9afb417398874508b38952cc"
format_stamp: "Formatted at 2026-06-20 14:56:24 on dist-test-slave-7v06"
server_key: "e7ea80ff5c043259c456e50c24cc6258"
server_key_iv: "6f0beda7bf804e9f745230f51c734b8c"
server_key_version: "encryptionkey@0"
I20260620 14:56:25.365880 19963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:25.376283 19963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:25.379408 19963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:25.379659 19963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:25.379976 19963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:25.380405 19963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:25.380466 19963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.380510 19963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:25.380528 19963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:25.387755 19963 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:43267
I20260620 14:56:25.387877 20091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:43267 every 8 connection(s)
I20260620 14:56:25.388855 19963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:25.390473 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 19963
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.189@KRBTEST.COM
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
Jun 20 14:56:25 dist-test-slave-7v06 krb5kdc[18810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967385, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.188@KRBTEST.COM
I20260620 14:56:25.402004 20105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.391780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54064 (local address 127.12.116.189:41665)
0620 14:56:25.391906 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.391908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.392297 (+ 389us) server_negotiation.cc:407] Connection header received
0620 14:56:25.392345 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.392345 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.392358 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.392412 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.393757 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.394472 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.395517 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.395924 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.395982 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.397729 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.397731 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.397731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.397738 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.400477 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.400948 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.400949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.400949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.401002 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.401261 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.401262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.401262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.401419 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.401504 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.401775 (+ 271us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.401868 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260620 14:56:25.402568 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.390329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:34315 (local address 127.12.116.189:41665)
0620 14:56:25.390371 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.390373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.390383 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:25.391573 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.391575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.391587 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.391641 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.393311 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.394068 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.395517 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.395923 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.395982 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.398880 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.398882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.398882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.398890 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.400787 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.401380 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.401381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.401381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.401427 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.401770 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.401771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.401771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.401889 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.401929 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.402420 (+ 491us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.402499 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":21}
I20260620 14:56:25.403236 20096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.389959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.12.116.131:34315)
0620 14:56:25.390161 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.390212 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.391443 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.391976 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.391983 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.392477 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.393193 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.393196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.394160 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.394161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.395409 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.395412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.396088 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.396089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.396251 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.396900 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.396911 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.398760 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.400881 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.400894 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.400897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.401299 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.401520 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.401520 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.401521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.401691 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.401976 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.401989 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.402239 (+ 250us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.402756 (+ 517us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.403029 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":4,"spinlock_wait_cycles":7936,"thread_start_us":110,"threads_started":1}
I20260620 14:56:25.403707 20094 heartbeater.cc:347] Connected to a master server at 127.12.116.189:41665
I20260620 14:56:25.403831 20094 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.404057 20094 heartbeater.cc:511] Master 127.12.116.189:41665 requested a full tablet report, sending...
I20260620 14:56:25.404942 19453 ts_manager.cc:194] Registered new tserver with Master: 769d010c9afb417398874508b38952cc (127.12.116.131:43267)
I20260620 14:56:25.405993 20097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.389959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:48315)
0620 14:56:25.390707 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.390716 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.391830 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.392668 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.392669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.392837 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.392902 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.392903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.393906 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.393907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.397063 (+ 3156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.397066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.397575 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.397653 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.398171 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.398175 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.400491 (+ 2316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.403829 (+ 3338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.403830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.403830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.404064 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.404365 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.404366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.404366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.404430 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.405584 (+ 1154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.405585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.405636 (+ 51us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.405706 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.405877 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":1304,"thread_start_us":108,"threads_started":1}
I20260620 14:56:25.406092 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.390283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:48315 (local address 127.12.116.190:38675)
0620 14:56:25.390441 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.390443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.390791 (+ 348us) server_negotiation.cc:407] Connection header received
0620 14:56:25.392547 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.392548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.392561 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.392618 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.392990 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.393762 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397144 (+ 3382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.397465 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397522 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.400594 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.400596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.400597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.400607 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.402619 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.404150 (+ 1531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.404152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.404152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.404213 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.405340 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.405342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.405342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.405486 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.405553 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.405908 (+ 355us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.405988 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260620 14:56:25.406769 20093 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38675
I20260620 14:56:25.406826 20093 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.406903 20093 heartbeater.cc:511] Master 127.12.116.190:38675 requested a full tablet report, sending...
I20260620 14:56:25.407188 20098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.389958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.12.116.131:44273)
0620 14:56:25.390560 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.390572 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.391717 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.392299 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.392300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.392582 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:25.392818 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.392825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.393906 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.393907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.395411 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.395413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.397576 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397576 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.397670 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.398490 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:25.398494 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:25.400826 (+ 2332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:25.405667 (+ 4841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.405667 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.405668 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.406243 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.406475 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:25.406476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:25.406476 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:25.406527 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:25.406827 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:25.406827 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:25.406872 (+ 45us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.406937 (+ 65us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.407057 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":68,"thread_start_us":121,"threads_started":1}
I20260620 14:56:25.407315 18855 ts_manager.cc:194] Re-registered known tserver with Master: 769d010c9afb417398874508b38952cc (127.12.116.131:43267)
I20260620 14:56:25.407575 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.390363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:44273 (local address 127.12.116.188:41453)
0620 14:56:25.390495 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.390497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.390633 (+ 136us) server_negotiation.cc:407] Connection header received
0620 14:56:25.392223 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.392224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.392235 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.392291 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.392959 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.393769 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397151 (+ 3382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.397453 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397517 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.402433 (+ 4916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.402435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.402435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.402444 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.405239 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.406341 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.406343 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.406343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.406414 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.406584 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.406585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.406585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.406730 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.406797 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.407360 (+ 563us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.407468 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260620 14:56:25.407756 18855 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:48315
I20260620 14:56:25.408151 20092 heartbeater.cc:347] Connected to a master server at 127.12.116.188:41453
I20260620 14:56:25.408200 20092 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:25.408267 20092 heartbeater.cc:511] Master 127.12.116.188:41453 requested a full tablet report, sending...
I20260620 14:56:25.408600 19640 ts_manager.cc:194] Registered new tserver with Master: 769d010c9afb417398874508b38952cc (127.12.116.131:43267)
I20260620 14:56:25.410246 20108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.392407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.12.116.190:38675)
0620 14:56:25.401525 (+ 9118us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.401527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.401537 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:25.401560 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.401561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.401576 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.401646 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.402708 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.403570 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.404778 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.405123 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.405518 (+ 395us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.406700 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.406702 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.406702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.406710 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.408822 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.409304 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.409304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.409305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.409356 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.409609 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.409610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.409610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.409768 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.409877 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.410031 (+ 154us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.410125 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9081,"thread_start_us":93,"threads_started":1}
I20260620 14:56:25.411094 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.392106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41196 (local address 127.12.116.188:41453)
0620 14:56:25.392213 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.392215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.394396 (+ 2181us) server_negotiation.cc:407] Connection header received
0620 14:56:25.394421 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.394421 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.394433 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.394487 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.395231 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.396055 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.397838 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.401007 (+ 3169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.401077 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.405395 (+ 4318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.405397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.405397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.405404 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.409591 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.409958 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.409960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.409960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.410025 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.410254 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.410255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.410255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.410406 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.410902 (+ 496us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.410947 (+ 45us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.411026 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
I20260620 14:56:25.412114 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.406635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41206 (local address 127.12.116.188:41453)
0620 14:56:25.407661 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.407664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.407683 (+ 19us) server_negotiation.cc:407] Connection header received
0620 14:56:25.407706 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.407707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.407736 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.408299 (+ 563us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:25.408362 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.409096 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.410531 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.411768 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.411871 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.411985 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.412010 (+ 25us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.412046 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1011,"thread_start_us":95,"threads_started":1}
I20260620 14:56:25.412127 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.406199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41206)
0620 14:56:25.406359 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.406369 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.406412 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.407847 (+ 1435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.407848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.407850 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:25.407900 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.407902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.409198 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.409199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.410429 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.410433 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.411873 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.411874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.411951 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.411955 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.412006 (+ 51us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.412060 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260620 14:56:25.412487 19650 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260620 14:56:25.412678 19679 sys_catalog.cc:455] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 836ae634df5a4cda8f288bbd35d30a5a. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:25.412792 19679 sys_catalog.cc:458] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: This master's current role is: LEARNER
I20260620 14:56:25.412416 18855 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:25.414707 18855 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:25.415701 19604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: NON_VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: true } } }
I20260620 14:56:25.415869 19604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:25.417970 19415 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: attempting to promote NON_VOTER e50cd77ce09a4ba7b5688b5db1bb7688 to VOTER
I20260620 14:56:25.418174 19415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:25.418799 19463 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Refusing update from remote peer 836ae634df5a4cda8f288bbd35d30a5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260620 14:56:25.419349 19603 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 14:56:25.420002 19650 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 LEARNER]: Refusing update from remote peer 836ae634df5a4cda8f288bbd35d30a5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260620 14:56:25.420279 19603 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 14:56:25.420822 19604 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.421057 19463 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.421509 19650 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.422618 19604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.422722 19679 sys_catalog.cc:455] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.422752 19414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.422701 19415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.422816 19679 sys_catalog.cc:458] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:56:25.422835 19414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:25.422845 19415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:25.422758 19604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:25.422897 19602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "836ae634df5a4cda8f288bbd35d30a5a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:25.423005 19602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:56:25.428519 20117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.423651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:43267 (local address 127.0.0.1:41232)
0620 14:56:25.423915 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.423925 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.423976 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.424465 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.424466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.424468 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:25.424534 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.424536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.426195 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.426198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.427201 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.427205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.428219 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.428220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.428279 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.428283 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.428390 (+ 107us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.428444 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":31,"thread_start_us":114,"threads_started":1}
I20260620 14:56:25.428548 20120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.423922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41232 (local address 127.12.116.131:43267)
0620 14:56:25.424193 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.424196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.424206 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:25.424250 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.424253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.424271 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.424404 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:25.424706 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.425894 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.427292 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.428120 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.428220 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.428282 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.428408 (+ 126us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.428457 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":85,"threads_started":1}
I20260620 14:56:25.428903 20118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.423743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:33625 (local address 127.0.0.1:54724)
0620 14:56:25.424499 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.424511 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.424573 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.424936 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.424937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.424939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:25.424988 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.424990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.426195 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.426197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.427274 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.427276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.428661 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.428662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.428740 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.428745 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.428801 (+ 56us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.428840 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":43,"thread_start_us":89,"threads_started":1}
I20260620 14:56:25.429092 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.423627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:36227 (local address 127.0.0.1:42906)
0620 14:56:25.423708 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.423722 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.423775 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.424952 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.424953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.424956 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:25.424999 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.425001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.426793 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.426794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.427835 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.427838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.428897 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.428898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.428958 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.428962 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.428991 (+ 29us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.429031 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260620 14:56:25.429148 20121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.423954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.12.116.129:33625)
0620 14:56:25.424142 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.424149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.424689 (+ 540us) server_negotiation.cc:407] Connection header received
0620 14:56:25.424742 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.424745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.424765 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.424868 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:25.425076 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.426073 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.427404 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.428131 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.428249 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.428317 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.429010 (+ 693us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.429070 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":98,"threads_started":1}
I20260620 14:56:25.429368 20026 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9e47e1cb674b8486da16f56a3d83b5 (DEFAULT_TABLE table=test-table [id=b95ff819af1a4bb0a1a1dfec0a990e19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:25.429786 20026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9e47e1cb674b8486da16f56a3d83b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:25.429773 19753 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9e47e1cb674b8486da16f56a3d83b5 (DEFAULT_TABLE table=test-table [id=b95ff819af1a4bb0a1a1dfec0a990e19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:25.430105 19753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9e47e1cb674b8486da16f56a3d83b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:25.432706 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.423719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.12.116.130:36227)
0620 14:56:25.424694 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.424698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.424706 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:25.424736 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.424738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.424756 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.425218 (+ 462us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:25.425288 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.426683 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.427922 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.428806 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.429295 (+ 489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.429359 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.432528 (+ 3169us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.432607 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":938,"thread_start_us":114,"threads_started":1}
I20260620 14:56:25.433405 19890 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9e47e1cb674b8486da16f56a3d83b5 (DEFAULT_TABLE table=test-table [id=b95ff819af1a4bb0a1a1dfec0a990e19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:25.433671 20122 tablet_bootstrap.cc:492] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Bootstrap starting.
I20260620 14:56:25.433784 19890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9e47e1cb674b8486da16f56a3d83b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:25.434357 20122 tablet_bootstrap.cc:654] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:25.434664 20122 log.cc:824] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:25.435231 20123 tablet_bootstrap.cc:492] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Bootstrap starting.
I20260620 14:56:25.435536 20122 tablet_bootstrap.cc:492] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: No bootstrap required, opened a new log
I20260620 14:56:25.435585 20122 ts_tablet_manager.cc:1397] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:25.436486 20123 tablet_bootstrap.cc:654] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:25.436825 20123 log.cc:824] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:25.437626 20122 raft_consensus.cc:348] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.437757 20122 raft_consensus.cc:374] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:25.437778 20122 raft_consensus.cc:729] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769d010c9afb417398874508b38952cc, State: Initialized, Role: FOLLOWER
I20260620 14:56:25.437765 20123 tablet_bootstrap.cc:492] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: No bootstrap required, opened a new log
I20260620 14:56:25.437839 20123 ts_tablet_manager.cc:1397] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:56:25.437906 20122 consensus_queue.cc:260] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.438196 20122 ts_tablet_manager.cc:1428] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 14:56:25.438297 20093 heartbeater.cc:503] Master 127.12.116.190:38675 was elected leader, sending a full tablet report...
I20260620 14:56:25.439909 20127 tablet_bootstrap.cc:492] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Bootstrap starting.
I20260620 14:56:25.440618 20127 tablet_bootstrap.cc:654] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:25.440575 20123 raft_consensus.cc:348] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.440768 20123 raft_consensus.cc:374] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:25.440811 20123 raft_consensus.cc:729] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aef9f1a940044f6b939273112044613, State: Initialized, Role: FOLLOWER
I20260620 14:56:25.440943 20127 log.cc:824] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:25.440940 20123 consensus_queue.cc:260] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.441218 20123 ts_tablet_manager.cc:1428] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260620 14:56:25.441462 19820 heartbeater.cc:503] Master 127.12.116.190:38675 was elected leader, sending a full tablet report...
I20260620 14:56:25.442387 20127 tablet_bootstrap.cc:492] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: No bootstrap required, opened a new log
I20260620 14:56:25.442451 20127 ts_tablet_manager.cc:1397] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260620 14:56:25.444082 20127 raft_consensus.cc:348] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.444243 20127 raft_consensus.cc:374] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:25.444269 20127 raft_consensus.cc:729] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9085e544cd1446aa4c35c86d1a37219, State: Initialized, Role: FOLLOWER
I20260620 14:56:25.444442 20127 consensus_queue.cc:260] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.444720 20127 ts_tablet_manager.cc:1428] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:25.444845 19957 heartbeater.cc:503] Master 127.12.116.190:38675 was elected leader, sending a full tablet report...
W20260620 14:56:25.487620 19959 tablet.cc:2369] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:56:25.575493 19822 tablet.cc:2369] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:25.636953 20126 raft_consensus.cc:482] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:25.637097 20126 raft_consensus.cc:504] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.637679 20126 leader_election.cc:288] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227), 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625)
I20260620 14:56:25.641074 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.637967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:33279 (local address 127.12.116.130:36227)
0620 14:56:25.638035 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.638037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.638049 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:25.638087 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.638088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.638097 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.638160 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:25.638338 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.638882 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.640041 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.640531 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.640597 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.640606 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.640907 (+ 301us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.640946 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 14:56:25.641283 20098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.637902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:36227 (local address 127.12.116.131:33279)
0620 14:56:25.637964 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.637978 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.638034 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.638176 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.638177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.638179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:25.638260 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.638263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.638974 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.638975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.639842 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.639845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.640633 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.640635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.640762 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.640769 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.640879 (+ 110us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.640954 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
W20260620 14:56:25.641330 20095 tablet.cc:2369] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:25.641481 20121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.638083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:48041 (local address 127.12.116.129:33625)
0620 14:56:25.638118 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.638120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.638131 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:25.638173 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.638174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.638183 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.638245 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:25.638491 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.639028 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.640224 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.640919 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.641084 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.641143 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.641346 (+ 203us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.641417 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 14:56:25.641536 20097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.637953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:33625 (local address 127.12.116.131:48041)
0620 14:56:25.638015 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:25.638027 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:25.638080 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:25.638332 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:25.638333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:25.638334 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:25.638397 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.638398 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.639146 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.639147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.640007 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:25.640009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.641027 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.641028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:25.641134 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.641140 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:56:25.641239 (+ 99us) client_negotiation.cc:240] Negotiation successful
0620 14:56:25.641302 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260620 14:56:25.641888 19773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9e47e1cb674b8486da16f56a3d83b5" candidate_uuid: "769d010c9afb417398874508b38952cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4aef9f1a940044f6b939273112044613" is_pre_election: true
I20260620 14:56:25.642071 19773 raft_consensus.cc:2454] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769d010c9afb417398874508b38952cc in term 0.
I20260620 14:56:25.642184 19910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9e47e1cb674b8486da16f56a3d83b5" candidate_uuid: "769d010c9afb417398874508b38952cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9085e544cd1446aa4c35c86d1a37219" is_pre_election: true
I20260620 14:56:25.642318 19981 leader_election.cc:302] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aef9f1a940044f6b939273112044613, 769d010c9afb417398874508b38952cc; no voters:
I20260620 14:56:25.642364 19910 raft_consensus.cc:2454] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769d010c9afb417398874508b38952cc in term 0.
I20260620 14:56:25.642483 20126 raft_consensus.cc:2781] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:25.642544 20126 raft_consensus.cc:482] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:25.642572 20126 raft_consensus.cc:3037] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:25.643361 20126 raft_consensus.cc:504] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.643525 20126 leader_election.cc:288] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [CANDIDATE]: Term 1 election: Requested vote from peers c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227), 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625)
I20260620 14:56:25.643682 19773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9e47e1cb674b8486da16f56a3d83b5" candidate_uuid: "769d010c9afb417398874508b38952cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4aef9f1a940044f6b939273112044613"
I20260620 14:56:25.643769 19773 raft_consensus.cc:3037] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:25.643817 19910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9e47e1cb674b8486da16f56a3d83b5" candidate_uuid: "769d010c9afb417398874508b38952cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9085e544cd1446aa4c35c86d1a37219"
I20260620 14:56:25.643901 19910 raft_consensus.cc:3037] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:25.644798 19773 raft_consensus.cc:2454] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769d010c9afb417398874508b38952cc in term 1.
I20260620 14:56:25.644807 19910 raft_consensus.cc:2454] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769d010c9afb417398874508b38952cc in term 1.
I20260620 14:56:25.644971 19981 leader_election.cc:302] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aef9f1a940044f6b939273112044613, 769d010c9afb417398874508b38952cc; no voters:
I20260620 14:56:25.645090 20126 raft_consensus.cc:2781] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:25.645406 20126 raft_consensus.cc:686] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 1 LEADER]: Becoming Leader. State: Replica: 769d010c9afb417398874508b38952cc, State: Running, Role: LEADER
I20260620 14:56:25.645557 20126 consensus_queue.cc:237] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:25.646934 18854 catalog_manager.cc:5495] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 769d010c9afb417398874508b38952cc (127.12.116.131). New cstate: current_term: 1 leader_uuid: "769d010c9afb417398874508b38952cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } health_report { overall_health: HEALTHY } } }
I20260620 14:56:25.661728 20120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.658991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41242 (local address 127.12.116.131:43267)
0620 14:56:25.659057 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.659059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.659067 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:25.659104 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.659104 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.659123 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.659188 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:25.659381 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.659893 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.660843 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.661045 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.661113 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.661320 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:25.661452 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:25.661550 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.661578 (+ 28us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.661600 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 14:56:25.663822 19773 raft_consensus.cc:1261] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Refusing update from remote peer 769d010c9afb417398874508b38952cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:25.664064 19910 raft_consensus.cc:1261] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Refusing update from remote peer 769d010c9afb417398874508b38952cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:25.664381 20126 consensus_queue.cc:1035] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:25.664551 20131 consensus_queue.cc:1035] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:25.668555 20135 mvcc.cc:205] Tried to move back new op lower bound from 7298938411675545600 to 7298938411604754432. Current Snapshot: MvccSnapshot[applied={T|T < 7298938411675545600}]
I20260620 14:56:25.670332 20137 mvcc.cc:205] Tried to move back new op lower bound from 7298938411675545600 to 7298938411604754432. Current Snapshot: MvccSnapshot[applied={T|T < 7298938411675545600}]
I20260620 14:56:25.671748 18854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:25.671868 18854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:25.673695 18854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 836ae634df5a4cda8f288bbd35d30a5a: Sending DeleteTablet for 3 replicas of tablet 1f9e47e1cb674b8486da16f56a3d83b5
I20260620 14:56:25.674114 20026 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9e47e1cb674b8486da16f56a3d83b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:25 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:41232
I20260620 14:56:25.674242 19753 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9e47e1cb674b8486da16f56a3d83b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:25 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54724
I20260620 14:56:25.674130 19890 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9e47e1cb674b8486da16f56a3d83b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:25 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:42906
I20260620 14:56:25.675028 20144 tablet_replica.cc:330] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: stopping tablet replica
I20260620 14:56:25.675190 20144 raft_consensus.cc:2229] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:25.675344 20144 raft_consensus.cc:2258] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:25.675526 20143 tablet_replica.cc:330] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: stopping tablet replica
I20260620 14:56:25.675637 20143 raft_consensus.cc:2229] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:25.675783 20143 raft_consensus.cc:2258] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:25.676429 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 18823
I20260620 14:56:25.677336 20143 ts_tablet_manager.cc:1905] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:25.679703 20143 ts_tablet_manager.cc:1918] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:25.679818 20143 log.cc:1196] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/1f9e47e1cb674b8486da16f56a3d83b5
I20260620 14:56:25.680119 20143 ts_tablet_manager.cc:1939] T 1f9e47e1cb674b8486da16f56a3d83b5 P 769d010c9afb417398874508b38952cc: Deleting consensus metadata
I20260620 14:56:25.681229 20144 ts_tablet_manager.cc:1905] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:25.683507 20144 ts_tablet_manager.cc:1918] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:25.683620 20144 log.cc:1196] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/1f9e47e1cb674b8486da16f56a3d83b5
W20260620 14:56:25.684003 19981 connection.cc:535] server connection from 127.0.0.1:41232 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 14:56:25.684181 20144 ts_tablet_manager.cc:1939] T 1f9e47e1cb674b8486da16f56a3d83b5 P 4aef9f1a940044f6b939273112044613: Deleting consensus metadata
W20260620 14:56:25.684638 19708 connection.cc:441] server connection from 127.0.0.1:54724 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54724 (request call id 1) could send its response
I20260620 14:56:25.686147 20145 tablet_replica.cc:330] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: stopping tablet replica
I20260620 14:56:25.686352 20145 raft_consensus.cc:2229] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:25.686528 20145 raft_consensus.cc:2258] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:25.689265 20145 ts_tablet_manager.cc:1905] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:25.692024 20145 ts_tablet_manager.cc:1918] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:25.692147 20145 log.cc:1196] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/1f9e47e1cb674b8486da16f56a3d83b5
I20260620 14:56:25.692562 20145 ts_tablet_manager.cc:1939] T 1f9e47e1cb674b8486da16f56a3d83b5 P c9085e544cd1446aa4c35c86d1a37219: Deleting consensus metadata
W20260620 14:56:25.693218 19843 connection.cc:441] server connection from 127.0.0.1:42906 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42906 (request call id 1) could send its response
I20260620 14:56:25.695326 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.675359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41218 (local address 127.12.116.188:41453)
0620 14:56:25.675409 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.675411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.680667 (+ 5256us) server_negotiation.cc:407] Connection header received
0620 14:56:25.680785 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.680786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.680801 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.680832 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.686723 (+ 5891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.687277 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.688623 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.688948 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.689019 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.691191 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.691193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.691193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.691202 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.693708 (+ 2506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.694113 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.694114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.694114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.694184 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.694424 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.694425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.694425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.694602 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.694695 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.694920 (+ 225us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.695219 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:25.697065 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.686069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41228 (local address 127.12.116.188:41453)
0620 14:56:25.686120 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.686122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.686381 (+ 259us) server_negotiation.cc:407] Connection header received
0620 14:56:25.686580 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.686581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.686598 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.686631 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.687853 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.688731 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.690719 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.691060 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.691106 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.693181 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.693183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.693184 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.693197 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.695094 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.696097 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.696099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.696099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.696173 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.696498 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.696498 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.696499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.696644 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.696758 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.696852 (+ 94us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.696947 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:56:25.702725 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:25.686605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54076 (local address 127.12.116.189:41665)
0620 14:56:25.686663 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:25.686665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:25.688890 (+ 2225us) server_negotiation.cc:407] Connection header received
0620 14:56:25.689002 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:25.689003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:25.689017 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:25.689047 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:25.694822 (+ 5775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.695608 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.696676 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:25.697009 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:25.697081 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:25.699015 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:25.699016 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:25.699017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:25.699025 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:25.701021 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.701617 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.701619 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.701619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.701695 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:25.702034 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:25.702035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:25.702036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:25.702219 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:25.702335 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:25.702517 (+ 182us) server_negotiation.cc:299] Negotiation successful
0620 14:56:25.702622 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 14:56:26.670553 20153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:26.670262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:59909)
0620 14:56:26.670405 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:26.670487 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
I20260620 14:56:26.670631 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:26.670367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:34141)
0620 14:56:26.670485 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:26.670583 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":60,"threads_started":1}
I20260620 14:56:26.670713 20155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:26.670490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:35199)
0620 14:56:26.670603 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:26.670665 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":50,"threads_started":1}
W20260620 14:56:26.670799 19820 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:38675 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
W20260620 14:56:26.670822 19957 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:38675 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
W20260620 14:56:26.671036 20093 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:38675 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.173868 20156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 836ae634df5a4cda8f288bbd35d30a5a)
I20260620 14:56:27.174039 20156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:27.174167 20157 raft_consensus.cc:482] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 836ae634df5a4cda8f288bbd35d30a5a)
I20260620 14:56:27.174379 20156 leader_election.cc:288] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675), e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188:41453)
I20260620 14:56:27.174314 20157 raft_consensus.cc:504] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:27.174584 20157 leader_election.cc:288] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675), 880bb7f4673e455a81357bcc53362d19 (127.12.116.189:41665)
I20260620 14:56:27.174866 20158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.174513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55398)
0620 14:56:27.174719 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.174815 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":64,"threads_started":1}
W20260620 14:56:27.175177 19437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.175379 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.174950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55414)
0620 14:56:27.175263 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.175329 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":130,"threads_started":1}
W20260620 14:56:27.175484 19624 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.175797 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.175696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55428)
0620 14:56:27.175734 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.175766 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260620 14:56:27.175940 19437 leader_election.cc:334] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.175956 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.175861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55438)
0620 14:56:27.175912 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.175934 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260620 14:56:27.176023 19624 leader_election.cc:334] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.177965 20158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.174545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:41453 (local address 127.0.0.1:41244)
0620 14:56:27.174920 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.174930 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:27.174996 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:27.175233 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:27.175235 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:27.175238 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:27.175307 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:27.175309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.176374 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.176375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:27.177147 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:27.177148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.177719 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.177719 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:27.177784 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:27.177788 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:27.177850 (+ 62us) client_negotiation.cc:240] Negotiation successful
0620 14:56:27.177892 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":172,"threads_started":1}
I20260620 14:56:27.178066 20163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.175057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54084 (local address 127.12.116.189:41665)
0620 14:56:27.175245 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:27.175247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:27.175254 (+ 7us) server_negotiation.cc:407] Connection header received
0620 14:56:27.175275 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:27.175276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:27.175285 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:27.175513 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:27.175546 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.176306 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.177320 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.177701 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.177804 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:27.177813 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:27.177955 (+ 142us) server_negotiation.cc:299] Negotiation successful
0620 14:56:27.177993 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":53,"threads_started":1}
I20260620 14:56:27.178097 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.174725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:41665 (local address 127.0.0.1:54084)
0620 14:56:27.175100 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.175110 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:27.175153 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:27.175395 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:27.175395 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:27.175398 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:27.175453 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:27.175455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.176424 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.176425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:27.177181 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:27.177184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.177806 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.177806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:27.177871 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:27.177874 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:27.177949 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 14:56:27.177996 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":56,"threads_started":1}
I20260620 14:56:27.178000 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.174846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41244 (local address 127.12.116.188:41453)
0620 14:56:27.175054 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:27.175057 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:27.175069 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:27.175100 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:27.175101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:27.175113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:27.175374 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:27.175413 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.176227 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.177248 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:27.177633 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:27.177722 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:27.177733 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:27.177868 (+ 135us) server_negotiation.cc:299] Negotiation successful
0620 14:56:27.177910 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":65,"threads_started":1}
I20260620 14:56:27.178357 19463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "880bb7f4673e455a81357bcc53362d19" is_pre_election: true
I20260620 14:56:27.178485 19463 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e50cd77ce09a4ba7b5688b5db1bb7688 in term 1.
I20260620 14:56:27.178457 19650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "880bb7f4673e455a81357bcc53362d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" is_pre_election: true
I20260620 14:56:27.178576 19650 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880bb7f4673e455a81357bcc53362d19 in term 1.
I20260620 14:56:27.178651 19625 leader_election.cc:302] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 880bb7f4673e455a81357bcc53362d19, e50cd77ce09a4ba7b5688b5db1bb7688; no voters: 836ae634df5a4cda8f288bbd35d30a5a
I20260620 14:56:27.178746 20157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 14:56:27.178793 20157 raft_consensus.cc:482] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 836ae634df5a4cda8f288bbd35d30a5a)
I20260620 14:56:27.178803 19439 leader_election.cc:302] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 880bb7f4673e455a81357bcc53362d19, e50cd77ce09a4ba7b5688b5db1bb7688; no voters: 836ae634df5a4cda8f288bbd35d30a5a
I20260620 14:56:27.178824 20157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:56:27.178926 20156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 14:56:27.178967 20156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 836ae634df5a4cda8f288bbd35d30a5a)
I20260620 14:56:27.178982 20156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:56:27.179690 20156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:27.179713 20157 raft_consensus.cc:504] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:27.179847 20156 leader_election.cc:288] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 2 election: Requested vote from peers 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675), e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188:41453)
I20260620 14:56:27.179903 20157 leader_election.cc:288] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [CANDIDATE]: Term 2 election: Requested vote from peers 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675), 880bb7f4673e455a81357bcc53362d19 (127.12.116.189:41665)
I20260620 14:56:27.180161 20158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.179945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55442)
0620 14:56:27.180103 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.180133 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260620 14:56:27.180116 19650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "880bb7f4673e455a81357bcc53362d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
I20260620 14:56:27.180176 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.180043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55450)
0620 14:56:27.180085 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.180120 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260620 14:56:27.180219 19650 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 880bb7f4673e455a81357bcc53362d19 in current term 2: Already voted for candidate e50cd77ce09a4ba7b5688b5db1bb7688 in this term.
I20260620 14:56:27.180429 19463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "880bb7f4673e455a81357bcc53362d19"
I20260620 14:56:27.180516 19463 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e50cd77ce09a4ba7b5688b5db1bb7688 in current term 2: Already voted for candidate 880bb7f4673e455a81357bcc53362d19 in this term.
I20260620 14:56:27.180548 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.180418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55466)
0620 14:56:27.180498 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.180521 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260620 14:56:27.180624 19624 leader_election.cc:334] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.180670 19625 leader_election.cc:302] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e50cd77ce09a4ba7b5688b5db1bb7688; no voters: 836ae634df5a4cda8f288bbd35d30a5a, 880bb7f4673e455a81357bcc53362d19
I20260620 14:56:27.180771 20158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.180569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55476)
0620 14:56:27.180702 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.180749 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260620 14:56:27.180773 20157 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260620 14:56:27.180853 19437 leader_election.cc:334] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:27.180893 19437 leader_election.cc:302] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880bb7f4673e455a81357bcc53362d19; no voters: 836ae634df5a4cda8f288bbd35d30a5a, e50cd77ce09a4ba7b5688b5db1bb7688
I20260620 14:56:27.180976 20156 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 14:56:27.671476 20167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.671175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:34313)
0620 14:56:27.671348 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.671404 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":63,"threads_started":1}
I20260620 14:56:27.671496 20166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.671125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:51829)
0620 14:56:27.671398 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.671439 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":69,"threads_started":1}
I20260620 14:56:27.671568 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:27.671392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:35485)
0620 14:56:27.671493 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:27.671523 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":53,"threads_started":1}
I20260620 14:56:28.672435 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.671974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:54929)
0620 14:56:28.672283 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.672369 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":76,"threads_started":1}
I20260620 14:56:28.672822 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.672288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:45987)
0620 14:56:28.672745 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.672785 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":103,"threads_started":1}
I20260620 14:56:28.672907 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.671996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:41529)
0620 14:56:28.672244 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.672302 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":90,"threads_started":1}
I20260620 14:56:28.724361 20172 raft_consensus.cc:482] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:28.724498 20172 raft_consensus.cc:504] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:28.724671 20172 leader_election.cc:288] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675), e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188:41453)
I20260620 14:56:28.725036 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.724852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55700)
0620 14:56:28.724950 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.724986 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":60,"threads_started":1}
I20260620 14:56:28.725003 19650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "880bb7f4673e455a81357bcc53362d19" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" is_pre_election: true
I20260620 14:56:28.725106 19650 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880bb7f4673e455a81357bcc53362d19 in term 2.
I20260620 14:56:28.725265 19439 leader_election.cc:302] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 880bb7f4673e455a81357bcc53362d19, e50cd77ce09a4ba7b5688b5db1bb7688; no voters:
I20260620 14:56:28.725365 20172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 14:56:28.725402 20172 raft_consensus.cc:482] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:28.725454 20172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:56:28.725559 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.725450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55712)
0620 14:56:28.725500 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.725527 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260620 14:56:28.725643 19437 leader_election.cc:334] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:28.726325 20172 raft_consensus.cc:504] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:28.726478 20172 leader_election.cc:288] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 3 election: Requested vote from peers 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675), e50cd77ce09a4ba7b5688b5db1bb7688 (127.12.116.188:41453)
I20260620 14:56:28.726662 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.726566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55718)
0620 14:56:28.726604 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.726634 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260620 14:56:28.726634 19650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "880bb7f4673e455a81357bcc53362d19" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688"
I20260620 14:56:28.726708 19650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:56:28.727068 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.726967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55726)
0620 14:56:28.727017 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.727047 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260620 14:56:28.727157 19437 leader_election.cc:334] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
I20260620 14:56:28.727561 19650 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880bb7f4673e455a81357bcc53362d19 in term 3.
I20260620 14:56:28.727778 19439 leader_election.cc:302] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 880bb7f4673e455a81357bcc53362d19, e50cd77ce09a4ba7b5688b5db1bb7688; no voters: 836ae634df5a4cda8f288bbd35d30a5a
I20260620 14:56:28.727880 20172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 14:56:28.728011 20172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [term 3 LEADER]: Becoming Leader. State: Replica: 880bb7f4673e455a81357bcc53362d19, State: Running, Role: LEADER
I20260620 14:56:28.728103 20172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } }
I20260620 14:56:28.728511 20175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 880bb7f4673e455a81357bcc53362d19. Latest consensus state: current_term: 3 leader_uuid: "880bb7f4673e455a81357bcc53362d19" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:28.728595 20175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:28.728741 20177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:28.729219 20177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:28.729313 20177 catalog_manager.cc:1259] Loaded cluster ID: 9dcfdfef212f43ada712c31ae0149293
I20260620 14:56:28.729349 20177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:28.729540 20177 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:28.729625 20177 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Loaded TSK: 0
I20260620 14:56:28.729775 20177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:28.804659 19451 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:28.806634 19451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:28.808027 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.807876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55740)
0620 14:56:28.807946 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.807992 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260620 14:56:28.808014 19650 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [term 3 FOLLOWER]: Refusing update from remote peer 880bb7f4673e455a81357bcc53362d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260620 14:56:28.808374 20175 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 14:56:28.808669 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.808425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.0.0.1:55748)
0620 14:56:28.808599 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.808639 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260620 14:56:28.808776 19437 consensus_peers.cc:487] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 -> Peer 836ae634df5a4cda8f288bbd35d30a5a (127.12.116.190:38675): Couldn't send request to peer 836ae634df5a4cda8f288bbd35d30a5a. Status: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:56:28.809161 20179 sys_catalog.cc:455] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 880bb7f4673e455a81357bcc53362d19. Latest consensus state: current_term: 3 leader_uuid: "880bb7f4673e455a81357bcc53362d19" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:28.809298 20179 sys_catalog.cc:458] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:56:28.809814 20178 mvcc.cc:205] Tried to move back new op lower bound from 7298938424553889792 to 7298938424230592512. Current Snapshot: MvccSnapshot[applied={T|T < 7298938424553889792}]
I20260620 14:56:28.809938 20172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "880bb7f4673e455a81357bcc53362d19" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:28.810034 20172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:28.810019 20180 mvcc.cc:205] Tried to move back new op lower bound from 7298938424553889792 to 7298938424230592512. Current Snapshot: MvccSnapshot[applied={T|T < 7298938424553889792}]
I20260620 14:56:28.810111 20179 sys_catalog.cc:455] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "880bb7f4673e455a81357bcc53362d19" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "836ae634df5a4cda8f288bbd35d30a5a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38675 } } peers { permanent_uuid: "880bb7f4673e455a81357bcc53362d19" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 41665 } attrs { promote: false } } peers { permanent_uuid: "e50cd77ce09a4ba7b5688b5db1bb7688" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 41453 } attrs { promote: false } } }
I20260620 14:56:28.810240 20179 sys_catalog.cc:458] T 00000000000000000000000000000000 P e50cd77ce09a4ba7b5688b5db1bb7688 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:56:28.817711 20186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.813661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41258 (local address 127.12.116.131:43267)
0620 14:56:28.813840 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:28.813842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:28.813850 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:28.813879 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:28.813880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:28.813890 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:28.814181 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:28.814246 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.815159 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.816769 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.817312 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.817416 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.817427 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:28.817577 (+ 150us) server_negotiation.cc:299] Negotiation successful
0620 14:56:28.817630 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":86,"threads_started":1}
I20260620 14:56:28.817711 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.813417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:43267 (local address 127.0.0.1:41258)
0620 14:56:28.813602 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.813615 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:28.813676 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:28.814102 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:28.814102 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:28.814105 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:28.814175 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.814177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.815247 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.815248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.816623 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.816627 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.817415 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.817416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.817480 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.817484 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:28.817568 (+ 84us) client_negotiation.cc:240] Negotiation successful
0620 14:56:28.817618 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":125,"threads_started":1}
I20260620 14:56:28.817961 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.813378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:36227 (local address 127.0.0.1:42916)
0620 14:56:28.813461 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.813480 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:28.813587 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:28.814502 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:28.814503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:28.814504 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:28.814598 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.814600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.815515 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.815516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.816652 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.816654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.817653 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.817653 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.817706 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.817710 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:28.817739 (+ 29us) client_negotiation.cc:240] Negotiation successful
0620 14:56:28.817796 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":31}
I20260620 14:56:28.817967 20187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.813887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:33625 (local address 127.0.0.1:54738)
0620 14:56:28.814284 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.814294 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:28.814345 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:28.814500 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:28.814500 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:28.814502 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:28.814565 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.814567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.815393 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.815394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.816746 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.816749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.817624 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.817625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.817688 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.817692 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:28.817741 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 14:56:28.817790 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":31,"thread_start_us":81,"threads_started":1}
I20260620 14:56:28.818041 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.814101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54738 (local address 127.12.116.129:33625)
0620 14:56:28.814301 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:28.814303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:28.814338 (+ 35us) server_negotiation.cc:407] Connection header received
0620 14:56:28.814410 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:28.814411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:28.814423 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:28.814501 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:28.814649 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.815305 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.816883 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.817499 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.817578 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.817588 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:28.817905 (+ 317us) server_negotiation.cc:299] Negotiation successful
0620 14:56:28.817954 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260620 14:56:28.818277 19753 tablet_service.cc:1467] Processing CreateTablet for tablet fa90aea32e59459ab0ca68fba28c8b61 (DEFAULT_TABLE table=test-table [id=f9680d64434b40bc9cb6a5f617cb8446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:28.818398 20026 tablet_service.cc:1467] Processing CreateTablet for tablet fa90aea32e59459ab0ca68fba28c8b61 (DEFAULT_TABLE table=test-table [id=f9680d64434b40bc9cb6a5f617cb8446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:28.818449 19753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa90aea32e59459ab0ca68fba28c8b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:28.818542 20026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa90aea32e59459ab0ca68fba28c8b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:28.818638 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.813493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42916 (local address 127.12.116.130:36227)
0620 14:56:28.814314 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:28.814316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:28.814361 (+ 45us) server_negotiation.cc:407] Connection header received
0620 14:56:28.814389 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:28.814390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:28.814403 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:28.814540 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:28.814689 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.815434 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.816986 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.817568 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.818473 (+ 905us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.818487 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:28.818509 (+ 22us) server_negotiation.cc:299] Negotiation successful
0620 14:56:28.818563 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":114,"threads_started":1}
I20260620 14:56:28.818840 19890 tablet_service.cc:1467] Processing CreateTablet for tablet fa90aea32e59459ab0ca68fba28c8b61 (DEFAULT_TABLE table=test-table [id=f9680d64434b40bc9cb6a5f617cb8446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:28.818950 19890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa90aea32e59459ab0ca68fba28c8b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:28.819917 20189 tablet_bootstrap.cc:492] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613: Bootstrap starting.
I20260620 14:56:28.820425 20189 tablet_bootstrap.cc:654] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:28.820689 20191 tablet_bootstrap.cc:492] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Bootstrap starting.
I20260620 14:56:28.821069 20190 tablet_bootstrap.cc:492] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Bootstrap starting.
I20260620 14:56:28.821213 20191 tablet_bootstrap.cc:654] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:28.821215 20189 tablet_bootstrap.cc:492] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613: No bootstrap required, opened a new log
I20260620 14:56:28.821275 20189 ts_tablet_manager.cc:1397] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:28.821476 20190 tablet_bootstrap.cc:654] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:28.821509 20189 raft_consensus.cc:348] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.821612 20189 raft_consensus.cc:374] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:28.821659 20189 raft_consensus.cc:729] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aef9f1a940044f6b939273112044613, State: Initialized, Role: FOLLOWER
I20260620 14:56:28.821756 20189 consensus_queue.cc:260] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.821893 20191 tablet_bootstrap.cc:492] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: No bootstrap required, opened a new log
I20260620 14:56:28.821976 20191 ts_tablet_manager.cc:1397] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:28.822009 20189 ts_tablet_manager.cc:1428] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:28.822158 20190 tablet_bootstrap.cc:492] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: No bootstrap required, opened a new log
I20260620 14:56:28.822261 20190 ts_tablet_manager.cc:1397] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:28.822455 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.822340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:38021)
0620 14:56:28.822382 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.822422 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260620 14:56:28.822472 20191 raft_consensus.cc:348] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.822773 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.822684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:60919)
0620 14:56:28.822723 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.822747 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260620 14:56:28.822763 20191 raft_consensus.cc:374] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:28.822786 19821 heartbeater.cc:503] Master 127.12.116.189:41665 was elected leader, sending a full tablet report...
I20260620 14:56:28.822806 20191 raft_consensus.cc:729] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9085e544cd1446aa4c35c86d1a37219, State: Initialized, Role: FOLLOWER
I20260620 14:56:28.822909 20191 consensus_queue.cc:260] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.822949 20190 raft_consensus.cc:348] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.823053 20190 raft_consensus.cc:374] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:28.823122 20190 raft_consensus.cc:729] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769d010c9afb417398874508b38952cc, State: Initialized, Role: FOLLOWER
I20260620 14:56:28.823154 20191 ts_tablet_manager.cc:1428] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:28.823222 20190 consensus_queue.cc:260] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.823638 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.823467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:57083)
0620 14:56:28.823566 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.823597 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260620 14:56:28.823634 20190 ts_tablet_manager.cc:1428] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:28.824002 19958 heartbeater.cc:503] Master 127.12.116.189:41665 was elected leader, sending a full tablet report...
I20260620 14:56:28.824002 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.823917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:49687)
0620 14:56:28.823954 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.823979 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260620 14:56:28.824424 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.824250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:54095)
0620 14:56:28.824319 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.824386 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260620 14:56:28.824950 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.824851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:47923)
0620 14:56:28.824889 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.824919 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260620 14:56:28.825099 20094 heartbeater.cc:503] Master 127.12.116.189:41665 was elected leader, sending a full tablet report...
I20260620 14:56:28.832109 20195 raft_consensus.cc:482] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:28.832223 20195 raft_consensus.cc:504] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.832738 20195 leader_election.cc:288] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227), 769d010c9afb417398874508b38952cc (127.12.116.131:43267)
I20260620 14:56:28.835873 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.832912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:43267 (local address 127.12.116.129:51447)
0620 14:56:28.832970 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.832983 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:28.833055 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:28.833316 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:28.833316 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:28.833320 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:28.833423 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.833425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.834119 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.834121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.834930 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.834932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.835564 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.835566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.835652 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.835656 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:28.835726 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 14:56:28.835775 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 14:56:28.835853 20186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.833014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:51447 (local address 127.12.116.131:43267)
0620 14:56:28.833059 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:28.833061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:28.833072 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:28.833178 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:28.833179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:28.833191 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:28.833266 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:28.833511 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.834017 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.835043 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.835454 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.835564 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.835575 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:28.835733 (+ 158us) server_negotiation.cc:299] Negotiation successful
0620 14:56:28.835775 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:28.836158 20046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa90aea32e59459ab0ca68fba28c8b61" candidate_uuid: "4aef9f1a940044f6b939273112044613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769d010c9afb417398874508b38952cc" is_pre_election: true
I20260620 14:56:28.836367 20046 raft_consensus.cc:2454] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4aef9f1a940044f6b939273112044613 in term 0.
I20260620 14:56:28.836596 19706 leader_election.cc:302] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aef9f1a940044f6b939273112044613, 769d010c9afb417398874508b38952cc; no voters:
I20260620 14:56:28.836761 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.833065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:36227 (local address 127.12.116.129:60053)
0620 14:56:28.833428 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.833440 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:28.833543 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:28.833736 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:28.833737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:28.833739 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:28.833837 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.833839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.834731 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.834733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.835521 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:28.835523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.836461 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.836463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:28.836577 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.836583 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:56:28.836641 (+ 58us) client_negotiation.cc:240] Negotiation successful
0620 14:56:28.836680 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":179,"threads_started":1}
I20260620 14:56:28.836786 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.833197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:60053 (local address 127.12.116.130:36227)
0620 14:56:28.833317 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:28.833320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:28.833521 (+ 201us) server_negotiation.cc:407] Connection header received
0620 14:56:28.833623 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:28.833624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:28.833644 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:28.833728 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:28.834077 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.834603 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.835752 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.836306 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.836411 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.836422 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:28.836648 (+ 226us) server_negotiation.cc:299] Negotiation successful
0620 14:56:28.836692 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260620 14:56:28.836809 20195 raft_consensus.cc:2781] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:28.836899 20195 raft_consensus.cc:482] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:28.836930 20195 raft_consensus.cc:3037] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:28.837028 19910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa90aea32e59459ab0ca68fba28c8b61" candidate_uuid: "4aef9f1a940044f6b939273112044613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9085e544cd1446aa4c35c86d1a37219" is_pre_election: true
I20260620 14:56:28.837127 19910 raft_consensus.cc:2454] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4aef9f1a940044f6b939273112044613 in term 0.
I20260620 14:56:28.837787 20195 raft_consensus.cc:504] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.837967 20195 leader_election.cc:288] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [CANDIDATE]: Term 1 election: Requested vote from peers c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227), 769d010c9afb417398874508b38952cc (127.12.116.131:43267)
I20260620 14:56:28.838135 20046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa90aea32e59459ab0ca68fba28c8b61" candidate_uuid: "4aef9f1a940044f6b939273112044613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769d010c9afb417398874508b38952cc"
I20260620 14:56:28.838238 20046 raft_consensus.cc:3037] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:28.838176 19910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa90aea32e59459ab0ca68fba28c8b61" candidate_uuid: "4aef9f1a940044f6b939273112044613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9085e544cd1446aa4c35c86d1a37219"
I20260620 14:56:28.838279 19910 raft_consensus.cc:3037] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:28.839030 20046 raft_consensus.cc:2454] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4aef9f1a940044f6b939273112044613 in term 1.
I20260620 14:56:28.839042 19910 raft_consensus.cc:2454] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4aef9f1a940044f6b939273112044613 in term 1.
I20260620 14:56:28.839205 19706 leader_election.cc:302] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aef9f1a940044f6b939273112044613, 769d010c9afb417398874508b38952cc; no voters:
I20260620 14:56:28.839676 20195 raft_consensus.cc:2781] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:28.840104 20195 raft_consensus.cc:686] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 1 LEADER]: Becoming Leader. State: Replica: 4aef9f1a940044f6b939273112044613, State: Running, Role: LEADER
I20260620 14:56:28.840262 20195 consensus_queue.cc:237] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } }
I20260620 14:56:28.840829 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.840686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:54133)
0620 14:56:28.840746 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.840784 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 14:56:28.841446 19451 catalog_manager.cc:5495] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4aef9f1a940044f6b939273112044613 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "4aef9f1a940044f6b939273112044613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4aef9f1a940044f6b939273112044613" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:28.850126 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.847599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54744 (local address 127.12.116.129:33625)
0620 14:56:28.847704 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:28.847706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:28.847715 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:28.847761 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:28.847762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:28.847782 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:28.847851 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:28.847973 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.848546 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.849328 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:28.849538 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:28.849600 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:28.849782 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:28.849891 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:28.849950 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:28.849993 (+ 43us) server_negotiation.cc:299] Negotiation successful
0620 14:56:28.850013 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260620 14:56:28.851532 19910 raft_consensus.cc:1261] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Refusing update from remote peer 4aef9f1a940044f6b939273112044613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:28.851553 20046 raft_consensus.cc:1261] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Refusing update from remote peer 4aef9f1a940044f6b939273112044613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:28.851900 20195 consensus_queue.cc:1035] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "769d010c9afb417398874508b38952cc" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 43267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:28.852077 20199 consensus_queue.cc:1035] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9085e544cd1446aa4c35c86d1a37219" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:28.852901 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.852770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:57591)
0620 14:56:28.852816 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.852860 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260620 14:56:28.853345 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.853195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:46779)
0620 14:56:28.853282 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.853311 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260620 14:56:28.854238 20205 mvcc.cc:205] Tried to move back new op lower bound from 7298938424733097984 to 7298938424690958336. Current Snapshot: MvccSnapshot[applied={T|T < 7298938424733097984}]
I20260620 14:56:28.854712 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.854482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:52925)
0620 14:56:28.854640 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.854675 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260620 14:56:28.855144 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.854940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.131:52727)
0620 14:56:28.854976 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.855108 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260620 14:56:28.856103 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.856008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.129:55631)
0620 14:56:28.856039 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.856069 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260620 14:56:28.859858 19453 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:28.860029 19453 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:28.861975 19453 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 880bb7f4673e455a81357bcc53362d19: Sending DeleteTablet for 3 replicas of tablet fa90aea32e59459ab0ca68fba28c8b61
I20260620 14:56:28.862412 19753 tablet_service.cc:1514] Processing DeleteTablet for tablet fa90aea32e59459ab0ca68fba28c8b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:28 UTC) from {username='oryx', principal='oryx/127.12.116.189@KRBTEST.COM'} at 127.0.0.1:54738
I20260620 14:56:28.862538 19890 tablet_service.cc:1514] Processing DeleteTablet for tablet fa90aea32e59459ab0ca68fba28c8b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:28 UTC) from {username='oryx', principal='oryx/127.12.116.189@KRBTEST.COM'} at 127.0.0.1:42916
I20260620 14:56:28.862737 20214 tablet_replica.cc:330] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613: stopping tablet replica
I20260620 14:56:28.862851 20214 raft_consensus.cc:2229] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:28.863008 20214 raft_consensus.cc:2258] T fa90aea32e59459ab0ca68fba28c8b61 P 4aef9f1a940044f6b939273112044613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:28.863128 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19600
I20260620 14:56:28.864289 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:28.864162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38675 (local address 127.12.116.130:53357)
0620 14:56:28.864214 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.864242 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 14:56:28.866372 20026 tablet_service.cc:1514] Processing DeleteTablet for tablet fa90aea32e59459ab0ca68fba28c8b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:28 UTC) from {username='oryx', principal='oryx/127.12.116.189@KRBTEST.COM'} at 127.0.0.1:41258
I20260620 14:56:28.866672 20216 tablet_replica.cc:330] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: stopping tablet replica
I20260620 14:56:28.866671 20215 tablet_replica.cc:330] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: stopping tablet replica
I20260620 14:56:28.866743 20215 raft_consensus.cc:2229] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:28.866811 20215 raft_consensus.cc:2258] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:28.866757 20216 raft_consensus.cc:2229] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:28.866909 20216 raft_consensus.cc:2258] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:28.867353 20215 ts_tablet_manager.cc:1905] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:28.867369 20216 ts_tablet_manager.cc:1905] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:28.869386 20215 ts_tablet_manager.cc:1918] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:28.869386 20216 ts_tablet_manager.cc:1918] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:28.869464 20216 log.cc:1196] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/fa90aea32e59459ab0ca68fba28c8b61
I20260620 14:56:28.869621 20215 log.cc:1196] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/fa90aea32e59459ab0ca68fba28c8b61
I20260620 14:56:28.869808 20216 ts_tablet_manager.cc:1939] T fa90aea32e59459ab0ca68fba28c8b61 P 769d010c9afb417398874508b38952cc: Deleting consensus metadata
I20260620 14:56:28.869995 20215 ts_tablet_manager.cc:1939] T fa90aea32e59459ab0ca68fba28c8b61 P c9085e544cd1446aa4c35c86d1a37219: Deleting consensus metadata
I20260620 14:56:28.870325 19438 catalog_manager.cc:4841] TS c9085e544cd1446aa4c35c86d1a37219 (127.12.116.130:36227): tablet fa90aea32e59459ab0ca68fba28c8b61 (table test-table [id=f9680d64434b40bc9cb6a5f617cb8446]) successfully deleted
I20260620 14:56:28.870303 19437 catalog_manager.cc:4841] TS 769d010c9afb417398874508b38952cc (127.12.116.131:43267): tablet fa90aea32e59459ab0ca68fba28c8b61 (table test-table [id=f9680d64434b40bc9cb6a5f617cb8446]) successfully deleted
W20260620 14:56:28.872409 20187 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:28.872138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:33625 (local address 127.0.0.1:54750)
0620 14:56:28.872194 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:28.872207 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:28.872265 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:28.872342 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:33625: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":29}
I20260620 14:56:28.872505 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19827
W20260620 14:56:28.872601 19439 catalog_manager.cc:4584] TS 4aef9f1a940044f6b939273112044613 (127.12.116.129:33625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa90aea32e59459ab0ca68fba28c8b61: Network error: Client connection negotiation failed: client connection to 127.12.116.129:33625: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260620 14:56:28.880661 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19963
I20260620 14:56:28.889896 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19319
I20260620 14:56:28.899798 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 19507
2026-06-20T14:56:28Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6781 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:28 dist-test-slave-7v06 krb5kdc[20219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:28 dist-test-slave-7v06 krb5kdc[20219](info): set up 2 sockets
Jun 20 14:56:28 dist-test-slave-7v06 krb5kdc[20219](info): commencing operation
krb5kdc: starting...
W20260620 14:56:30.029525 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab.
Entry for principal oryx/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab.
I20260620 14:56:30.192564 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:45237
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab
--principal=oryx/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:45237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:30.288617 20232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:30.288972 20232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:30.289007 20232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:30.291690 20232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:30.291805 20232 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260620 14:56:30.291821 20232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:30.291836 20232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:30.291849 20232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:30.291863 20232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:30.294394 20232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:45237
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.190.keytab
--principal=oryx/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:45237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:30.294780 20232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:30.295073 20232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:30.302498 20237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:30.302716 20232 server_base.cc:1034] running on GCE node
W20260620 14:56:30.302621 20240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:30.302498 20238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:30.303128 20232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:30.303478 20232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:30.304704 20232 hybrid_clock.cc:648] HybridClock initialized: now 1781967390304677 us; error 46 us; skew 500 ppm
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:30.313086 20232 init.cc:377] Logged in from keytab as oryx/127.12.116.190@KRBTEST.COM (short username oryx)
I20260620 14:56:30.313758 20232 webserver.cc:460] Webserver started at http://127.12.116.190:42839/ using document root <none> and password file <none>
I20260620 14:56:30.314059 20232 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:30.314122 20232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:30.314242 20232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:30.315505 20232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "74ffdca82d134dc6b2155982b8ef8977"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "b2fd5c699eb2b5380b342c1250accf63"
server_key_iv: "700e62582013308ae4b0536af5f55fe3"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.315868 20232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "74ffdca82d134dc6b2155982b8ef8977"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "b2fd5c699eb2b5380b342c1250accf63"
server_key_iv: "700e62582013308ae4b0536af5f55fe3"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.318439 20232 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:56:30.320113 20247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:30.320843 20232 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:30.320998 20232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "74ffdca82d134dc6b2155982b8ef8977"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "b2fd5c699eb2b5380b342c1250accf63"
server_key_iv: "700e62582013308ae4b0536af5f55fe3"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.321138 20232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:30.341149 20232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:30.343931 20232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:30.344403 20232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:30.350337 20232 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:45237
I20260620 14:56:30.350479 20309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:45237 every 8 connection(s)
I20260620 14:56:30.350819 20232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:30.351578 20310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:30.354387 20310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Bootstrap starting.
I20260620 14:56:30.355031 20310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:30.355293 20310 log.cc:824] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:30.356073 20310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: No bootstrap required, opened a new log
I20260620 14:56:30.358392 20310 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ffdca82d134dc6b2155982b8ef8977" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 45237 } }
I20260620 14:56:30.358582 20310 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:30.358606 20310 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ffdca82d134dc6b2155982b8ef8977, State: Initialized, Role: FOLLOWER
I20260620 14:56:30.358785 20310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ffdca82d134dc6b2155982b8ef8977" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 45237 } }
I20260620 14:56:30.358897 20310 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:30.358935 20310 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:30.359014 20310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:30.359167 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 20232
I20260620 14:56:30.359285 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:30.359577 12754 external_mini_cluster.cc:1428] Setting key 98d77643b4989f12211e06387a86e549
I20260620 14:56:30.359936 20310 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ffdca82d134dc6b2155982b8ef8977" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 45237 } }
I20260620 14:56:30.360242 20310 leader_election.cc:302] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74ffdca82d134dc6b2155982b8ef8977; no voters:
I20260620 14:56:30.360755 20310 leader_election.cc:288] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:30.360805 20315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:30.361258 20315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [term 1 LEADER]: Becoming Leader. State: Replica: 74ffdca82d134dc6b2155982b8ef8977, State: Running, Role: LEADER
I20260620 14:56:30.361403 20310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:30.361447 20315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ffdca82d134dc6b2155982b8ef8977" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 45237 } }
I20260620 14:56:30.361944 20317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74ffdca82d134dc6b2155982b8ef8977" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ffdca82d134dc6b2155982b8ef8977" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 45237 } } }
I20260620 14:56:30.361958 20316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74ffdca82d134dc6b2155982b8ef8977. Latest consensus state: current_term: 1 leader_uuid: "74ffdca82d134dc6b2155982b8ef8977" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ffdca82d134dc6b2155982b8ef8977" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 45237 } } }
I20260620 14:56:30.362180 20316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:30.362164 20317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:30.362483 20324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:30.363198 20324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:30.365248 20324 catalog_manager.cc:1347] Generated new cluster ID: 5fff262957fe4e0c80b166081f3bc4d3
I20260620 14:56:30.365374 20324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:30.372112 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.360535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43882 (local address 127.12.116.190:45237)
0620 14:56:30.360820 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:30.360831 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:30.360871 (+ 40us) server_negotiation.cc:407] Connection header received
0620 14:56:30.361062 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:30.361070 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:30.361146 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:30.361312 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:30.362240 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.363687 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.364748 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.365254 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.365382 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.367890 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:30.367896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:30.367896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:30.367911 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:30.370348 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.370783 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.370793 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.370794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.370895 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.371111 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.371113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.371113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.371394 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:30.371570 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:30.371657 (+ 87us) server_negotiation.cc:299] Negotiation successful
0620 14:56:30.371922 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":129,"threads_started":1}
I20260620 14:56:30.378131 20324 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:30.378738 20324 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:30.400954 20324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Generated new TSK 0
I20260620 14:56:30.401216 20324 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab.
Entry for principal oryx/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab.
I20260620 14:56:30.437229 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:45237
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:30.554281 20336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:30.554553 20336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:30.554584 20336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:30.556057 20336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:30.556128 20336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:30.556154 20336 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:56:30.556174 20336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:30.558085 20336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:45237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:30.558413 20336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:30.558669 20336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:30.565310 20344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:30.565302 20341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:30.565851 20336 server_base.cc:1034] running on GCE node
W20260620 14:56:30.565302 20342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:30.566205 20336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:30.566530 20336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:30.567766 20336 hybrid_clock.cc:648] HybridClock initialized: now 1781967390567722 us; error 87 us; skew 500 ppm
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:30.571552 20336 init.cc:377] Logged in from keytab as oryx/127.12.116.129@KRBTEST.COM (short username oryx)
I20260620 14:56:30.572680 20336 webserver.cc:460] Webserver started at http://127.12.116.129:40423/ using document root <none> and password file <none>
I20260620 14:56:30.572994 20336 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:30.573076 20336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:30.573251 20336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:30.574409 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "836290e1f5c844239187a8e976504d9d"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "3e63ddc441530ede2a1367b24b1c664e"
server_key_iv: "1b9543cbabc368f95e83aeb0605f5234"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.574805 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "836290e1f5c844239187a8e976504d9d"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "3e63ddc441530ede2a1367b24b1c664e"
server_key_iv: "1b9543cbabc368f95e83aeb0605f5234"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.576946 20336 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260620 14:56:30.578405 20351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:30.578935 20336 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:30.579095 20336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "836290e1f5c844239187a8e976504d9d"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "3e63ddc441530ede2a1367b24b1c664e"
server_key_iv: "1b9543cbabc368f95e83aeb0605f5234"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.579237 20336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:30.608777 20336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:30.611672 20336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:30.612449 20336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:30.613327 20336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:30.613413 20336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:30.613471 20336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:30.613507 20336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:30.623099 20336 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:37241
I20260620 14:56:30.623204 20466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:37241 every 8 connection(s)
I20260620 14:56:30.623529 20336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:30.625905 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.614206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:44251 (local address 127.12.116.190:45237)
0620 14:56:30.614315 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:30.614318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:30.614598 (+ 280us) server_negotiation.cc:407] Connection header received
0620 14:56:30.615290 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:30.615291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:30.615315 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:30.615444 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:30.616845 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.617521 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.619115 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.619407 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.619503 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.622448 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:30.622450 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:30.622451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:30.622460 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:30.624330 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.624817 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.624819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.624819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.624899 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.625171 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.625173 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.625173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.625318 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:30.625402 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:30.625707 (+ 305us) server_negotiation.cc:299] Negotiation successful
0620 14:56:30.625805 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260620 14:56:30.626132 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.614147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.12.116.129:44251)
0620 14:56:30.614418 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:30.614471 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:30.615150 (+ 679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:30.615727 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:30.615732 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:30.616276 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:30.616709 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.616715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.617635 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.617636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.618804 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.618808 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.619551 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.619553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.619791 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.620714 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:30.620724 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:30.622312 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:30.624462 (+ 2150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.624469 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.624471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.624723 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.624978 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.624979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.624980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.625102 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.625401 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:30.625409 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:30.625565 (+ 156us) client_negotiation.cc:769] Sending connection context
0620 14:56:30.625685 (+ 120us) client_negotiation.cc:240] Negotiation successful
0620 14:56:30.625879 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":141,"threads_started":1}
I20260620 14:56:30.627739 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 20336
I20260620 14:56:30.627837 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:30.628124 12754 external_mini_cluster.cc:1428] Setting key 1449f7ee6b7924f400394d9861364c64
I20260620 14:56:30.628453 20467 heartbeater.cc:347] Connected to a master server at 127.12.116.190:45237
I20260620 14:56:30.628582 20467 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:30.628844 20467 heartbeater.cc:511] Master 127.12.116.190:45237 requested a full tablet report, sending...
I20260620 14:56:30.629415 20263 ts_manager.cc:194] Registered new tserver with Master: 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241)
I20260620 14:56:30.630082 20263 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:44251
I20260620 14:56:30.638103 20473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.627874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.12.116.129:55663)
0620 14:56:30.628020 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:30.628030 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:30.628099 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:30.628323 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:30.628324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:30.628589 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:30.628683 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.628686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.629637 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.629639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.630861 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.630865 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.631294 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.631295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.631363 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.632029 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:30.632034 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:30.632493 (+ 459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:30.634664 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.634666 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.634667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.634992 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.635409 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.635470 (+ 61us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.635471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.635567 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.637150 (+ 1583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:30.637152 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:30.637238 (+ 86us) client_negotiation.cc:769] Sending connection context
0620 14:56:30.637761 (+ 523us) client_negotiation.cc:240] Negotiation successful
0620 14:56:30.637981 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260620 14:56:30.638109 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.627949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:55663 (local address 127.12.116.190:45237)
0620 14:56:30.627996 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:30.627998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:30.628104 (+ 106us) server_negotiation.cc:407] Connection header received
0620 14:56:30.628138 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:30.628139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:30.628152 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:30.628235 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:30.628778 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.629521 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.630963 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.631184 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.631293 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.632597 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:30.632599 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:30.632599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:30.632608 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:30.634449 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.635165 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.635168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.635168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.635268 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.635985 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.635987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.635988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.636358 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:30.636459 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:30.637827 (+ 1368us) server_negotiation.cc:299] Negotiation successful
0620 14:56:30.637948 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab.
Entry for principal oryx/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab.
I20260620 14:56:30.664142 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:45237
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:30.797169 20476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:30.797612 20476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:30.798058 20476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:30.800609 20476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:30.800731 20476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:30.800776 20476 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:56:30.800825 20476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:30.803325 20476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:45237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:30.803774 20476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:30.804247 20476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:30.811234 20484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:30.811332 20482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:30.811234 20481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:30.811640 20476 server_base.cc:1034] running on GCE node
I20260620 14:56:30.812120 20476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:30.812623 20476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:30.813921 20476 hybrid_clock.cc:648] HybridClock initialized: now 1781967390813845 us; error 101 us; skew 500 ppm
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:30.819378 20476 init.cc:377] Logged in from keytab as oryx/127.12.116.130@KRBTEST.COM (short username oryx)
I20260620 14:56:30.820307 20476 webserver.cc:460] Webserver started at http://127.12.116.130:35981/ using document root <none> and password file <none>
I20260620 14:56:30.820959 20476 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:30.821097 20476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:30.821293 20476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:30.822705 20476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "6ea089969f4e4f33b422305404cf93d8"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "5956ff0f36a874c717dc67dc3485215a"
server_key_iv: "024dd64c5e8d8b33a4884e3a103af816"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.823200 20476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "6ea089969f4e4f33b422305404cf93d8"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "5956ff0f36a874c717dc67dc3485215a"
server_key_iv: "024dd64c5e8d8b33a4884e3a103af816"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.825130 20476 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 14:56:30.826768 20491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:30.827234 20476 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:30.827363 20476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6ea089969f4e4f33b422305404cf93d8"
format_stamp: "Formatted at 2026-06-20 14:56:30 on dist-test-slave-7v06"
server_key: "5956ff0f36a874c717dc67dc3485215a"
server_key_iv: "024dd64c5e8d8b33a4884e3a103af816"
server_key_version: "encryptionkey@0"
I20260620 14:56:30.827490 20476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:30.847944 20476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:30.850661 20476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:30.850865 20476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:30.851476 20476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:30.851545 20476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:30.851706 20476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:30.851783 20476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:30.863160 20476 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:44143
Jun 20 14:56:30 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:30.863236 20606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:44143 every 8 connection(s)
I20260620 14:56:30.863682 20476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:30.864140 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 20476
I20260620 14:56:30.864264 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:30.864543 12754 external_mini_cluster.cc:1428] Setting key 737cd5251c825eed3df64df61eaf0b70
I20260620 14:56:30.867203 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.853264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:40805 (local address 127.12.116.190:45237)
0620 14:56:30.853345 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:30.853348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:30.853360 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:30.853893 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:30.853894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:30.853908 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:30.853967 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:30.854816 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.856754 (+ 1938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.859869 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.860564 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.860721 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.863872 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:30.863874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:30.863874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:30.863883 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:30.865669 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.866127 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.866129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.866129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.866191 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.866480 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.866481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.866481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.866619 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:30.866693 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:30.867005 (+ 312us) server_negotiation.cc:299] Negotiation successful
0620 14:56:30.867101 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260620 14:56:30.867450 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.852949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.12.116.130:40805)
0620 14:56:30.853157 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:30.853202 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:30.853755 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:30.854051 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:30.854057 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:30.854417 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:30.854684 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.854690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.856931 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.856934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.859667 (+ 2733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.859675 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.860786 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.860789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.860987 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.861684 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:30.861695 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:30.863754 (+ 2059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:30.865763 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.865772 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.865775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.866043 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.866278 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.866279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.866279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.866409 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.866694 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:30.866702 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:30.866864 (+ 162us) client_negotiation.cc:769] Sending connection context
0620 14:56:30.866983 (+ 119us) client_negotiation.cc:240] Negotiation successful
0620 14:56:30.867176 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":120,"threads_started":1}
I20260620 14:56:30.868002 20607 heartbeater.cc:347] Connected to a master server at 127.12.116.190:45237
I20260620 14:56:30.868114 20607 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:30.868376 20607 heartbeater.cc:511] Master 127.12.116.190:45237 requested a full tablet report, sending...
I20260620 14:56:30.868825 20264 ts_manager.cc:194] Registered new tserver with Master: 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143)
I20260620 14:56:30.869390 20264 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:40805
WARNING: no policy specified for oryx/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:56:30.877243 20614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.869184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.12.116.130:54631)
0620 14:56:30.869586 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:30.869599 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:30.869662 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:30.869821 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:30.869823 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:30.870064 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:30.870150 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.870154 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.871094 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.871096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.871908 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:30.871912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.872365 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.872366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:30.872432 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.873004 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:30.873010 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:30.873352 (+ 342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:30.875461 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.875462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.875463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.875686 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.875915 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:30.875916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:30.875916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:30.875981 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:30.876404 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:30.876405 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:30.876462 (+ 57us) client_negotiation.cc:769] Sending connection context
0620 14:56:30.876553 (+ 91us) client_negotiation.cc:240] Negotiation successful
0620 14:56:30.877113 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":83,"threads_started":1}
I20260620 14:56:30.877226 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:30.869259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:54631 (local address 127.12.116.190:45237)
0620 14:56:30.869302 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:30.869304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:30.869645 (+ 341us) server_negotiation.cc:407] Connection header received
0620 14:56:30.869727 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:30.869728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:30.869739 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:30.869812 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:30.870250 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.870784 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.872022 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:30.872245 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:30.872373 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:30.873479 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:30.873480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:30.873481 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:30.873489 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:30.875329 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.875767 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.875768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.875768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.875837 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:30.876047 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:30.876048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:30.876048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:30.876291 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:30.876414 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:30.876580 (+ 166us) server_negotiation.cc:299] Negotiation successful
0620 14:56:30.877108 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab.
Entry for principal oryx/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab.
I20260620 14:56:30.904608 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:45237
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:31.007053 20616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:31.007293 20616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:31.007323 20616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:31.008637 20616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:31.008692 20616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:31.008714 20616 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 14:56:31.008735 20616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:31.010445 20616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.116.190:45237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:31.010697 20616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:31.010892 20616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:31.017841 20621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:31.017830 20622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:31.017830 20624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:31.018302 20616 server_base.cc:1034] running on GCE node
I20260620 14:56:31.018549 20616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:31.018851 20616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:31.020108 20616 hybrid_clock.cc:648] HybridClock initialized: now 1781967391020077 us; error 43 us; skew 500 ppm
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967391, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:31.023463 20616 init.cc:377] Logged in from keytab as oryx/127.12.116.131@KRBTEST.COM (short username oryx)
I20260620 14:56:31.024042 20616 webserver.cc:460] Webserver started at http://127.12.116.131:43905/ using document root <none> and password file <none>
I20260620 14:56:31.024364 20616 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:31.024454 20616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:31.024600 20616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:31.025852 20616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "b4f4feb68cab4374a6f98418c1d6666f"
format_stamp: "Formatted at 2026-06-20 14:56:31 on dist-test-slave-7v06"
server_key: "14c740d6acc6b15d6fa1c40070d90375"
server_key_iv: "77225fe17256ffe5b14f352d28a2b766"
server_key_version: "encryptionkey@0"
I20260620 14:56:31.026257 20616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "b4f4feb68cab4374a6f98418c1d6666f"
format_stamp: "Formatted at 2026-06-20 14:56:31 on dist-test-slave-7v06"
server_key: "14c740d6acc6b15d6fa1c40070d90375"
server_key_iv: "77225fe17256ffe5b14f352d28a2b766"
server_key_version: "encryptionkey@0"
I20260620 14:56:31.027953 20616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:31.029163 20631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:31.029503 20616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:31.029598 20616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "b4f4feb68cab4374a6f98418c1d6666f"
format_stamp: "Formatted at 2026-06-20 14:56:31 on dist-test-slave-7v06"
server_key: "14c740d6acc6b15d6fa1c40070d90375"
server_key_iv: "77225fe17256ffe5b14f352d28a2b766"
server_key_version: "encryptionkey@0"
I20260620 14:56:31.029731 20616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:31.049194 20616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:31.052184 20616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:31.052407 20616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:31.053167 20616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:31.053224 20616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:31.053272 20616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:31.053287 20616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967391, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:31.061981 20616 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:39557
I20260620 14:56:31.062089 20746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:39557 every 8 connection(s)
I20260620 14:56:31.062551 20616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:31.065428 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.053655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.12.116.131:53787)
0620 14:56:31.053871 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.053928 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.054735 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.055424 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.055430 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.055819 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:31.056128 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.056135 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.057047 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.057049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.058016 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.058019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.058479 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.058480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.058626 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.059363 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:31.059407 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:31.061672 (+ 2265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:31.063840 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:31.063847 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:31.063849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:31.064106 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:31.064300 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:31.064301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:31.064301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:31.064474 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:31.064755 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:31.064762 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:31.064929 (+ 167us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.065050 (+ 121us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.065212 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":103,"threads_started":1}
I20260620 14:56:31.065586 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.053677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:53787 (local address 127.12.116.190:45237)
0620 14:56:31.053766 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.053769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.054064 (+ 295us) server_negotiation.cc:407] Connection header received
0620 14:56:31.055086 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.055089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.055113 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.055258 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.056260 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.056926 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.058125 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.058336 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.058439 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.061885 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:31.061888 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:31.061889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:31.061902 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:31.063718 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.064188 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.064189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.064189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.064246 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.064534 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.064535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.064536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.064659 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:31.064718 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.065174 (+ 456us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.065487 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260620 14:56:31.065989 20747 heartbeater.cc:347] Connected to a master server at 127.12.116.190:45237
I20260620 14:56:31.066083 20747 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:31.066318 20747 heartbeater.cc:511] Master 127.12.116.190:45237 requested a full tablet report, sending...
I20260620 14:56:31.066776 20263 ts_manager.cc:194] Registered new tserver with Master: b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.067312 20263 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:53787
I20260620 14:56:31.071553 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 20616
I20260620 14:56:31.071750 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:31.071966 12754 external_mini_cluster.cc:1428] Setting key 3eed6afc86ec9b77458bee2a5af3295f
I20260620 14:56:31.073364 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:56:31.074616 20753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.067109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.12.116.131:52695)
0620 14:56:31.067243 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.067255 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.067325 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.067544 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.067545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.067771 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:31.067848 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.067850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.068809 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.068810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.069429 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.069431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.069864 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.069866 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.069921 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.070435 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:31.070440 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:31.070791 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:31.073297 (+ 2506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:31.073298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:31.073299 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:31.073604 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:31.073836 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:31.073836 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:31.073837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:31.073910 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:31.074266 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:31.074267 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:31.074323 (+ 56us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.074399 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.074518 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260620 14:56:31.074707 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.067180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:52695 (local address 127.12.116.190:45237)
0620 14:56:31.067258 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.067260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.067305 (+ 45us) server_negotiation.cc:407] Connection header received
0620 14:56:31.067386 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.067387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.067398 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.067452 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.068035 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.068690 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.069538 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.069769 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.069839 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.070996 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:31.070999 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:31.071000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:31.071013 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:31.073219 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.073686 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.073687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.073688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.073759 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.073976 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.073977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.073977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.074141 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:31.074235 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.074449 (+ 214us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.074554 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967391, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
W20260620 14:56:31.102643 20314 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:31.093368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39676 (local address 127.12.116.190:45237)
0620 14:56:31.093485 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.093487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.093494 (+ 7us) server_negotiation.cc:407] Connection header received
0620 14:56:31.093520 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.093521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.093531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.093590 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.094472 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.095191 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.097064 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.098144 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.098272 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.102538 (+ 4266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39676: BlockingRecv error: recv got EOF from 127.0.0.1:39676 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967391, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:31.111828 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.103687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39678 (local address 127.12.116.190:45237)
0620 14:56:31.103758 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.103760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.103908 (+ 148us) server_negotiation.cc:407] Connection header received
0620 14:56:31.103962 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.103962 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.103972 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.104022 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.104672 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.105169 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.105945 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.106154 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.106266 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.108764 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:31.108767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:31.108767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:31.108776 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:31.110336 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.110824 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.110826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.110826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.110887 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.111183 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.111184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.111184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.111324 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:31.111411 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.111590 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.111668 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 14:56:31.114106 20263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:31.115779 20263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:31.123606 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.119506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.12.116.130:44143)
0620 14:56:31.119707 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.119711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.119722 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:31.119761 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.119763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.119779 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.119918 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.120032 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.120940 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.122310 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.123095 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.123206 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.123278 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.123447 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.123492 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":97,"threads_started":1}
I20260620 14:56:31.123598 20769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.118589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39557 (local address 127.0.0.1:47794)
0620 14:56:31.118902 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.118945 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.119012 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.119276 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.119279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.119283 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.119369 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.119372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.120974 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.120976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.122379 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.122382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.123250 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.123251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.123315 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.123337 (+ 22us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.123422 (+ 85us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.123522 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":60,"thread_start_us":262,"threads_started":1}
I20260620 14:56:31.123598 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.119197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44143 (local address 127.0.0.1:37798)
0620 14:56:31.119319 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.119327 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.119366 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.119917 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.119917 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.119920 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.119974 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.119976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.121057 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.121058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.122197 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.122200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.123194 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.123195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.123315 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.123337 (+ 22us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.123422 (+ 85us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.123499 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":91,"thread_start_us":79,"threads_started":1}
I20260620 14:56:31.124040 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.118866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47794 (local address 127.12.116.131:39557)
0620 14:56:31.119040 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.119045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.119060 (+ 15us) server_negotiation.cc:407] Connection header received
0620 14:56:31.119109 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.119111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.119124 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.119455 (+ 331us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.119522 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.120829 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.122472 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.123167 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.123260 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.123331 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.123894 (+ 563us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.123941 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":114,"threads_started":1}
I20260620 14:56:31.124583 20771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.119027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37241 (local address 127.0.0.1:42190)
0620 14:56:31.119239 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.119250 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.119305 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.119747 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.119748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.119750 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.119791 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.119793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.121152 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.121153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.122384 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.122385 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.124376 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.124377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.124459 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.124464 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.124493 (+ 29us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.124528 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":45,"thread_start_us":79,"threads_started":1}
I20260620 14:56:31.124886 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.119255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42190 (local address 127.12.116.129:37241)
0620 14:56:31.119525 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.119529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.119538 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:31.119580 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.119582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.119608 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.119685 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.119866 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.121052 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.123379 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.124166 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.124689 (+ 523us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.124748 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.124771 (+ 23us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.124810 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":63,"threads_started":1}
I20260620 14:56:31.124750 20681 tablet_service.cc:1467] Processing CreateTablet for tablet 08ead329888044388f314765c5faf6d5 (DEFAULT_TABLE table=test-table [id=b30dd6c77e5a405da73bf5f8c8923008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.124750 20541 tablet_service.cc:1467] Processing CreateTablet for tablet 08ead329888044388f314765c5faf6d5 (DEFAULT_TABLE table=test-table [id=b30dd6c77e5a405da73bf5f8c8923008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.125154 20541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ead329888044388f314765c5faf6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.125171 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ead329888044388f314765c5faf6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.129805 20775 tablet_bootstrap.cc:492] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Bootstrap starting.
I20260620 14:56:31.130831 20775 tablet_bootstrap.cc:654] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.130997 20401 tablet_service.cc:1467] Processing CreateTablet for tablet 08ead329888044388f314765c5faf6d5 (DEFAULT_TABLE table=test-table [id=b30dd6c77e5a405da73bf5f8c8923008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.131242 20775 log.cc:824] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:31.131444 20401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ead329888044388f314765c5faf6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.131686 20776 tablet_bootstrap.cc:492] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Bootstrap starting.
I20260620 14:56:31.132378 20775 tablet_bootstrap.cc:492] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: No bootstrap required, opened a new log
I20260620 14:56:31.132457 20775 ts_tablet_manager.cc:1397] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:56:31.132782 20776 tablet_bootstrap.cc:654] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.133127 20776 log.cc:824] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:31.134110 20776 tablet_bootstrap.cc:492] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: No bootstrap required, opened a new log
I20260620 14:56:31.134193 20776 ts_tablet_manager.cc:1397] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:56:31.134640 20775 raft_consensus.cc:348] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.134829 20775 raft_consensus.cc:374] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.134874 20775 raft_consensus.cc:729] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea089969f4e4f33b422305404cf93d8, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.135023 20775 consensus_queue.cc:260] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.135349 20607 heartbeater.cc:503] Master 127.12.116.190:45237 was elected leader, sending a full tablet report...
I20260620 14:56:31.135696 20780 tablet_bootstrap.cc:492] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Bootstrap starting.
I20260620 14:56:31.136508 20780 tablet_bootstrap.cc:654] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.136505 20775 ts_tablet_manager.cc:1428] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 14:56:31.136858 20776 raft_consensus.cc:348] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.137162 20776 raft_consensus.cc:374] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.137228 20776 raft_consensus.cc:729] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.137303 20780 log.cc:824] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:31.137420 20776 consensus_queue.cc:260] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.137730 20776 ts_tablet_manager.cc:1428] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260620 14:56:31.137794 20747 heartbeater.cc:503] Master 127.12.116.190:45237 was elected leader, sending a full tablet report...
I20260620 14:56:31.138156 20780 tablet_bootstrap.cc:492] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: No bootstrap required, opened a new log
I20260620 14:56:31.138211 20780 ts_tablet_manager.cc:1397] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:56:31.139968 20780 raft_consensus.cc:348] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.140133 20780 raft_consensus.cc:374] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.140156 20780 raft_consensus.cc:729] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.140298 20780 consensus_queue.cc:260] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.140621 20780 ts_tablet_manager.cc:1428] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:31.140739 20467 heartbeater.cc:503] Master 127.12.116.190:45237 was elected leader, sending a full tablet report...
I20260620 14:56:31.292411 20782 raft_consensus.cc:482] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:31.292557 20782 raft_consensus.cc:504] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.293030 20782 leader_election.cc:288] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241), 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143)
I20260620 14:56:31.296463 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.293317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37241 (local address 127.12.116.131:39507)
0620 14:56:31.293384 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.293397 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.293447 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.293748 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.293749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.293751 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.293830 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.293832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.294523 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.294525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.295507 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.295510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.296129 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.296130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.296226 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.296229 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.296298 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.296373 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":7}
I20260620 14:56:31.296463 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.293528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39507 (local address 127.12.116.129:37241)
0620 14:56:31.293587 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.293590 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.293600 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:31.293634 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.293635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.293653 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.293883 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.293919 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.294431 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.295622 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.296015 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.296128 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.296139 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.296346 (+ 207us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.296392 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 14:56:31.296852 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.293720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:56721 (local address 127.12.116.130:44143)
0620 14:56:31.293774 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.293776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.293786 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:31.293814 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.293815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.293823 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.293981 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.294157 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.294653 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.296007 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.296476 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.296568 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.296579 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.296730 (+ 151us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.296787 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:56:31.296867 20784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.293481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44143 (local address 127.12.116.131:56721)
0620 14:56:31.293656 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.293668 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.293747 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.293984 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.293985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.293988 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.294077 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.294078 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.294744 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.294746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.295877 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.295880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.296582 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.296583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.296651 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.296655 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.296716 (+ 61us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.296760 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":4,"thread_start_us":144,"threads_started":1}
I20260620 14:56:31.296941 20421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ead329888044388f314765c5faf6d5" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836290e1f5c844239187a8e976504d9d" is_pre_election: true
I20260620 14:56:31.297138 20421 raft_consensus.cc:2454] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 0.
I20260620 14:56:31.297286 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ead329888044388f314765c5faf6d5" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8" is_pre_election: true
I20260620 14:56:31.297446 20561 raft_consensus.cc:2454] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 0.
I20260620 14:56:31.297528 20632 leader_election.cc:302] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836290e1f5c844239187a8e976504d9d, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.297755 20782 raft_consensus.cc:2781] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:31.297825 20782 raft_consensus.cc:482] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:31.297855 20782 raft_consensus.cc:3037] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.298983 20782 raft_consensus.cc:504] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.299154 20782 leader_election.cc:288] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 election: Requested vote from peers 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241), 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143)
I20260620 14:56:31.299465 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ead329888044388f314765c5faf6d5" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8"
I20260620 14:56:31.299558 20561 raft_consensus.cc:3037] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.299615 20421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ead329888044388f314765c5faf6d5" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836290e1f5c844239187a8e976504d9d"
I20260620 14:56:31.299803 20421 raft_consensus.cc:3037] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.300763 20561 raft_consensus.cc:2454] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 1.
I20260620 14:56:31.301054 20421 raft_consensus.cc:2454] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 1.
I20260620 14:56:31.301054 20632 leader_election.cc:302] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea089969f4e4f33b422305404cf93d8, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.301261 20782 raft_consensus.cc:2781] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:31.301524 20782 raft_consensus.cc:686] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 1 LEADER]: Becoming Leader. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Running, Role: LEADER
I20260620 14:56:31.301658 20782 consensus_queue.cc:237] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } }
I20260620 14:56:31.302762 20263 catalog_manager.cc:5495] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f reported cstate change: term changed from 0 to 1, leader changed from <none> to b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131). New cstate: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } health_report { overall_health: UNKNOWN } } }
W20260620 14:56:31.313586 20748 tablet.cc:2369] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:31.314047 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.311052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47798 (local address 127.12.116.131:39557)
0620 14:56:31.311133 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.311135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.311146 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:31.311186 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.311187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.311214 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.311288 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:31.311472 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.311963 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.312887 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.313139 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.313219 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.313508 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.313647 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.313755 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.313895 (+ 140us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.313945 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260620 14:56:31.316403 20421 raft_consensus.cc:1261] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Refusing update from remote peer b4f4feb68cab4374a6f98418c1d6666f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.316424 20561 raft_consensus.cc:1261] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Refusing update from remote peer b4f4feb68cab4374a6f98418c1d6666f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.316972 20782 consensus_queue.cc:1035] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.317256 20785 consensus_queue.cc:1035] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.320200 20788 mvcc.cc:205] Tried to move back new op lower bound from 7298938434828025856 to 7298938434772512768. Current Snapshot: MvccSnapshot[applied={T|T < 7298938434828025856}]
I20260620 14:56:31.320534 20790 mvcc.cc:205] Tried to move back new op lower bound from 7298938434828025856 to 7298938434772512768. Current Snapshot: MvccSnapshot[applied={T|T < 7298938434828025856}]
I20260620 14:56:31.323052 20264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:31.323185 20264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:31.324276 20264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Sending DeleteTablet for 3 replicas of tablet 08ead329888044388f314765c5faf6d5
I20260620 14:56:31.324908 20681 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ead329888044388f314765c5faf6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:47794
I20260620 14:56:31.324908 20541 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ead329888044388f314765c5faf6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:37798
I20260620 14:56:31.324945 20401 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ead329888044388f314765c5faf6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:42190
I20260620 14:56:31.325527 20798 tablet_replica.cc:330] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: stopping tablet replica
I20260620 14:56:31.325657 20798 raft_consensus.cc:2229] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:31.325600 20264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:31.325778 20264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:31.325848 20798 raft_consensus.cc:2258] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.326442 20798 ts_tablet_manager.cc:1905] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.327205 20799 tablet_replica.cc:330] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: stopping tablet replica
I20260620 14:56:31.327333 20799 raft_consensus.cc:2229] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:31.327484 20799 raft_consensus.cc:2258] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.327675 20800 tablet_replica.cc:330] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: stopping tablet replica
I20260620 14:56:31.327668 20681 tablet_service.cc:1467] Processing CreateTablet for tablet eed2adcf47e641ceb2e7050d4c167fbd (DEFAULT_TABLE table=test-table [id=d84d0278c0954db8a745161ed093406c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.327807 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed2adcf47e641ceb2e7050d4c167fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.327814 20800 raft_consensus.cc:2229] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:31.327811 20541 tablet_service.cc:1467] Processing CreateTablet for tablet eed2adcf47e641ceb2e7050d4c167fbd (DEFAULT_TABLE table=test-table [id=d84d0278c0954db8a745161ed093406c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.327929 20541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed2adcf47e641ceb2e7050d4c167fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.327945 20800 raft_consensus.cc:2258] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.329473 20775 tablet_bootstrap.cc:492] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Bootstrap starting.
I20260620 14:56:31.329751 20776 tablet_bootstrap.cc:492] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Bootstrap starting.
I20260620 14:56:31.330092 20798 ts_tablet_manager.cc:1918] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:31.330125 20775 tablet_bootstrap.cc:654] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.330175 20798 log.cc:1196] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/08ead329888044388f314765c5faf6d5
I20260620 14:56:31.330184 20776 tablet_bootstrap.cc:654] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.330526 20798 ts_tablet_manager.cc:1939] T 08ead329888044388f314765c5faf6d5 P 6ea089969f4e4f33b422305404cf93d8: Deleting consensus metadata
I20260620 14:56:31.331065 20401 tablet_service.cc:1467] Processing CreateTablet for tablet eed2adcf47e641ceb2e7050d4c167fbd (DEFAULT_TABLE table=test-table [id=d84d0278c0954db8a745161ed093406c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.331220 20401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed2adcf47e641ceb2e7050d4c167fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.331300 20248 catalog_manager.cc:4841] TS 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143): tablet 08ead329888044388f314765c5faf6d5 (table test-table [id=b30dd6c77e5a405da73bf5f8c8923008]) successfully deleted
I20260620 14:56:31.331401 20775 tablet_bootstrap.cc:492] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: No bootstrap required, opened a new log
I20260620 14:56:31.331447 20775 ts_tablet_manager.cc:1397] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:31.331620 20775 raft_consensus.cc:348] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.331736 20775 raft_consensus.cc:374] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.331763 20775 raft_consensus.cc:729] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea089969f4e4f33b422305404cf93d8, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.331815 20775 consensus_queue.cc:260] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.331933 20775 ts_tablet_manager.cc:1428] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:56:31.332122 20800 ts_tablet_manager.cc:1905] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.332862 20780 tablet_bootstrap.cc:492] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Bootstrap starting.
I20260620 14:56:31.333424 20780 tablet_bootstrap.cc:654] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.334414 20780 tablet_bootstrap.cc:492] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: No bootstrap required, opened a new log
I20260620 14:56:31.334483 20780 ts_tablet_manager.cc:1397] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:56:31.334662 20780 raft_consensus.cc:348] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.334765 20780 raft_consensus.cc:374] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.334790 20780 raft_consensus.cc:729] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.334838 20780 consensus_queue.cc:260] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.334980 20780 ts_tablet_manager.cc:1428] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:31.335242 20800 ts_tablet_manager.cc:1918] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:31.335348 20800 log.cc:1196] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/08ead329888044388f314765c5faf6d5
I20260620 14:56:31.335438 20799 ts_tablet_manager.cc:1905] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.335716 20800 ts_tablet_manager.cc:1939] T 08ead329888044388f314765c5faf6d5 P 836290e1f5c844239187a8e976504d9d: Deleting consensus metadata
I20260620 14:56:31.337100 20248 catalog_manager.cc:4841] TS 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241): tablet 08ead329888044388f314765c5faf6d5 (table test-table [id=b30dd6c77e5a405da73bf5f8c8923008]) successfully deleted
I20260620 14:56:31.337282 20776 tablet_bootstrap.cc:492] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: No bootstrap required, opened a new log
I20260620 14:56:31.337378 20776 ts_tablet_manager.cc:1397] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20260620 14:56:31.337574 20776 raft_consensus.cc:348] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.337670 20776 raft_consensus.cc:374] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.337702 20776 raft_consensus.cc:729] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.337783 20776 consensus_queue.cc:260] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.337843 20799 ts_tablet_manager.cc:1918] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:31.337920 20776 ts_tablet_manager.cc:1428] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:31.337920 20799 log.cc:1196] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/08ead329888044388f314765c5faf6d5
I20260620 14:56:31.338467 20799 ts_tablet_manager.cc:1939] T 08ead329888044388f314765c5faf6d5 P b4f4feb68cab4374a6f98418c1d6666f: Deleting consensus metadata
I20260620 14:56:31.338975 20248 catalog_manager.cc:4841] TS b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557): tablet 08ead329888044388f314765c5faf6d5 (table test-table [id=b30dd6c77e5a405da73bf5f8c8923008]) successfully deleted
I20260620 14:56:31.364583 20783 raft_consensus.cc:482] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:31.364698 20783 raft_consensus.cc:504] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
W20260620 14:56:31.365211 20608 tablet.cc:2369] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:31.365182 20783 leader_election.cc:288] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143), b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.369725 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.365490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:50769 (local address 127.12.116.130:44143)
0620 14:56:31.365571 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.365574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.365688 (+ 114us) server_negotiation.cc:407] Connection header received
0620 14:56:31.365825 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.365827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.365840 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.365879 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.366129 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.366925 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.368607 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.369251 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.369322 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.369332 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.369588 (+ 256us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.369640 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260620 14:56:31.369757 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.365442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44143 (local address 127.12.116.129:50769)
0620 14:56:31.365597 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.365610 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.365724 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.365963 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.365964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.365966 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.366053 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.366055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.367054 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.367055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.368489 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.368499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.369372 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.369373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.369453 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.369457 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.369571 (+ 114us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.369625 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260620 14:56:31.370072 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.365756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:48965 (local address 127.12.116.131:39557)
0620 14:56:31.365825 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.365827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.365917 (+ 90us) server_negotiation.cc:407] Connection header received
0620 14:56:31.365973 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.365974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.365984 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.366043 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.366219 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.366907 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.368470 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.369207 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.369313 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.369326 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.369931 (+ 605us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.369993 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:56:31.369760 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.365658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39557 (local address 127.12.116.129:48965)
0620 14:56:31.365827 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.365838 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.365903 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.366067 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.366068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.366069 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.366140 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.366142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.367029 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.367030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.368292 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.368298 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.369331 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.369333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.369459 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.369465 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.369541 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.369597 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":43,"thread_start_us":88,"threads_started":1}
I20260620 14:56:31.370368 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed2adcf47e641ceb2e7050d4c167fbd" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8" is_pre_election: true
I20260620 14:56:31.370496 20561 raft_consensus.cc:2454] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 0.
I20260620 14:56:31.370441 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed2adcf47e641ceb2e7050d4c167fbd" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4feb68cab4374a6f98418c1d6666f" is_pre_election: true
I20260620 14:56:31.370599 20701 raft_consensus.cc:2454] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 0.
I20260620 14:56:31.370857 20352 leader_election.cc:302] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836290e1f5c844239187a8e976504d9d, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.371163 20783 raft_consensus.cc:2781] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:31.371291 20783 raft_consensus.cc:482] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:31.371316 20783 raft_consensus.cc:3037] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.372613 20783 raft_consensus.cc:504] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.372937 20783 leader_election.cc:288] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 election: Requested vote from peers 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143), b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.373297 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed2adcf47e641ceb2e7050d4c167fbd" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8"
I20260620 14:56:31.373312 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed2adcf47e641ceb2e7050d4c167fbd" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4feb68cab4374a6f98418c1d6666f"
I20260620 14:56:31.373401 20561 raft_consensus.cc:3037] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.373433 20701 raft_consensus.cc:3037] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.374191 20701 raft_consensus.cc:2454] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 1.
I20260620 14:56:31.374279 20561 raft_consensus.cc:2454] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 1.
W20260620 14:56:31.374531 20468 tablet.cc:2369] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:31.374531 20352 leader_election.cc:302] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836290e1f5c844239187a8e976504d9d, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.374706 20783 raft_consensus.cc:2781] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:31.374882 20783 raft_consensus.cc:686] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 1 LEADER]: Becoming Leader. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Running, Role: LEADER
I20260620 14:56:31.374960 20783 consensus_queue.cc:237] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.375811 20264 catalog_manager.cc:5495] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 836290e1f5c844239187a8e976504d9d (127.12.116.129). New cstate: current_term: 1 leader_uuid: "836290e1f5c844239187a8e976504d9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } health_report { overall_health: UNKNOWN } } }
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967390, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.190@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:31.417670 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.409273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39688 (local address 127.12.116.190:45237)
0620 14:56:31.409341 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.409343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.409451 (+ 108us) server_negotiation.cc:407] Connection header received
0620 14:56:31.409525 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.409526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.409536 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.409590 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.410259 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.410797 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.411833 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.412045 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.412114 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.414774 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:31.414776 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:31.414777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:31.414785 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:31.416282 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.416819 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.416820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.416820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.416879 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.417081 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.417082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.417082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.417203 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:31.417297 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.417435 (+ 138us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.417524 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 14:56:31.417689 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.409175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:45237 (local address 127.0.0.1:39688)
0620 14:56:31.409361 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.409374 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.409460 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.409621 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.409622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.410044 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:31.410106 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.410109 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.410900 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.410901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.411706 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.411709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.412148 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.412149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.412212 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.412933 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:31.412939 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:31.414660 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:31.416472 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:31.416484 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:31.416487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:31.416714 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:31.416946 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:31.416947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:31.416948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:31.417017 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:31.417270 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:31.417278 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:31.417326 (+ 48us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.417398 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.417594 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":80,"thread_start_us":92,"threads_started":1}
I20260620 14:56:31.419883 20264 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:39688:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260620 14:56:31.420075 20264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:31.421672 20401 tablet_service.cc:1467] Processing CreateTablet for tablet d47137e654464e9385ec77b2034f0b13 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6fc02ece36cb404bacec334a59cf441a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:56:31.421679 20681 tablet_service.cc:1467] Processing CreateTablet for tablet d47137e654464e9385ec77b2034f0b13 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6fc02ece36cb404bacec334a59cf441a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:56:31.421681 20541 tablet_service.cc:1467] Processing CreateTablet for tablet d47137e654464e9385ec77b2034f0b13 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6fc02ece36cb404bacec334a59cf441a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 14:56:31.421852 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d47137e654464e9385ec77b2034f0b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.421854 20401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d47137e654464e9385ec77b2034f0b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.421852 20541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d47137e654464e9385ec77b2034f0b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.423434 20776 tablet_bootstrap.cc:492] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: Bootstrap starting.
I20260620 14:56:31.423434 20775 tablet_bootstrap.cc:492] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: Bootstrap starting.
I20260620 14:56:31.423550 20780 tablet_bootstrap.cc:492] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: Bootstrap starting.
I20260620 14:56:31.423882 20775 tablet_bootstrap.cc:654] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.423882 20776 tablet_bootstrap.cc:654] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.423964 20780 tablet_bootstrap.cc:654] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.424741 20775 tablet_bootstrap.cc:492] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: No bootstrap required, opened a new log
I20260620 14:56:31.424804 20775 ts_tablet_manager.cc:1397] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:31.424978 20775 raft_consensus.cc:348] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.425063 20775 raft_consensus.cc:374] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.425079 20775 raft_consensus.cc:729] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea089969f4e4f33b422305404cf93d8, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.425068 20780 tablet_bootstrap.cc:492] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: No bootstrap required, opened a new log
I20260620 14:56:31.425127 20780 ts_tablet_manager.cc:1397] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:56:31.425148 20775 consensus_queue.cc:260] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.425239 20775 ts_tablet_manager.cc:1428] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:31.425276 20780 raft_consensus.cc:348] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.425348 20780 raft_consensus.cc:374] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.425372 20780 raft_consensus.cc:729] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.425303 20779 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.425413 20779 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.425414 20780 consensus_queue.cc:260] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.425513 20780 ts_tablet_manager.cc:1428] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:31.425738 20783 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.425818 20783 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.425832 20776 tablet_bootstrap.cc:492] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: No bootstrap required, opened a new log
I20260620 14:56:31.425881 20776 ts_tablet_manager.cc:1397] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:56:31.426247 20776 raft_consensus.cc:348] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.426633 20776 raft_consensus.cc:374] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.426693 20776 raft_consensus.cc:729] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.426749 20776 consensus_queue.cc:260] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.426896 20776 ts_tablet_manager.cc:1428] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260620 14:56:31.426940 20795 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.427023 20795 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.589582 20795 raft_consensus.cc:482] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:31.589681 20795 raft_consensus.cc:504] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.589897 20795 leader_election.cc:288] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241), 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143)
I20260620 14:56:31.590368 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47137e654464e9385ec77b2034f0b13" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8" is_pre_election: true
I20260620 14:56:31.590380 20421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47137e654464e9385ec77b2034f0b13" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836290e1f5c844239187a8e976504d9d" is_pre_election: true
I20260620 14:56:31.590502 20421 raft_consensus.cc:2454] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 0.
I20260620 14:56:31.590682 20632 leader_election.cc:302] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836290e1f5c844239187a8e976504d9d, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.590710 20561 raft_consensus.cc:2454] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 0.
I20260620 14:56:31.590966 20795 raft_consensus.cc:2781] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:31.591053 20795 raft_consensus.cc:482] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:31.591094 20795 raft_consensus.cc:3037] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.592201 20795 raft_consensus.cc:504] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.592654 20795 leader_election.cc:288] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 election: Requested vote from peers 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241), 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143)
I20260620 14:56:31.592931 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47137e654464e9385ec77b2034f0b13" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8"
I20260620 14:56:31.592955 20421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47137e654464e9385ec77b2034f0b13" candidate_uuid: "b4f4feb68cab4374a6f98418c1d6666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836290e1f5c844239187a8e976504d9d"
I20260620 14:56:31.593040 20561 raft_consensus.cc:3037] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.593039 20421 raft_consensus.cc:3037] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.593657 20561 raft_consensus.cc:2454] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 1.
I20260620 14:56:31.593847 20632 leader_election.cc:302] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea089969f4e4f33b422305404cf93d8, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.593966 20795 raft_consensus.cc:2781] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:31.594050 20795 raft_consensus.cc:686] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [term 1 LEADER]: Becoming Leader. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Running, Role: LEADER
I20260620 14:56:31.594046 20421 raft_consensus.cc:2454] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4f4feb68cab4374a6f98418c1d6666f in term 1.
I20260620 14:56:31.594106 20795 consensus_queue.cc:237] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.594458 20782 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: TxnStatusTablet state changed. Reason: New leader b4f4feb68cab4374a6f98418c1d6666f. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.594561 20782 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:56:31.594827 20818 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 14:56:31.594964 20818 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 14:56:31.594997 20264 catalog_manager.cc:5495] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f reported cstate change: term changed from 0 to 1, leader changed from <none> to b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131). New cstate: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } health_report { overall_health: HEALTHY } } }
I20260620 14:56:31.617964 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.615067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39557 (local address 127.0.0.1:47808)
0620 14:56:31.615149 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.615161 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.615219 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.615428 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.615430 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.615431 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:31.615514 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.615522 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.616214 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.616215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.616977 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.616980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.617426 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.617427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.617516 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.617540 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.617762 (+ 222us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.617771 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.617827 (+ 56us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.617888 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 14:56:31.617949 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.615154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.12.116.131:39557)
0620 14:56:31.615210 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.615212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.615224 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:31.615329 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.615330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.615342 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.615420 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:31.615594 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.616114 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.617104 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.617336 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.617426 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.617634 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.617675 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.617746 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.617829 (+ 83us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.617856 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:56:31.619215 20421 raft_consensus.cc:1261] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Refusing update from remote peer b4f4feb68cab4374a6f98418c1d6666f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.619215 20561 raft_consensus.cc:1261] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Refusing update from remote peer b4f4feb68cab4374a6f98418c1d6666f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.619477 20795 consensus_queue.cc:1035] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.619655 20795 consensus_queue.cc:1035] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.620182 20783 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: TxnStatusTablet state changed. Reason: New leader b4f4feb68cab4374a6f98418c1d6666f. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.620281 20783 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.621043 20782 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.621150 20782 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:56:31.621057 20779 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: TxnStatusTablet state changed. Reason: New leader b4f4feb68cab4374a6f98418c1d6666f. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.621197 20779 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.622004 20795 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.622097 20795 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P b4f4feb68cab4374a6f98418c1d6666f: This TxnStatusTablet replica's current role is: LEADER
I20260620 14:56:31.622197 20789 mvcc.cc:205] Tried to move back new op lower bound from 7298938436069994496 to 7298938435969691648. Current Snapshot: MvccSnapshot[applied={T|T < 7298938436069994496}]
I20260620 14:56:31.622304 20783 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.622404 20783 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P 836290e1f5c844239187a8e976504d9d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.623993 20779 tablet_replica.cc:439] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4f4feb68cab4374a6f98418c1d6666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } } }
I20260620 14:56:31.624121 20779 tablet_replica.cc:442] T d47137e654464e9385ec77b2034f0b13 P 6ea089969f4e4f33b422305404cf93d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 14:56:31.627542 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.623804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42196 (local address 127.12.116.129:37241)
0620 14:56:31.624050 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.624054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.624061 (+ 7us) server_negotiation.cc:407] Connection header received
0620 14:56:31.624093 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.624093 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.624111 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.624177 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:31.624390 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.625221 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.626354 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.626690 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.626796 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.627008 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.627274 (+ 266us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.627378 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.627446 (+ 68us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.627472 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
I20260620 14:56:31.639770 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.636607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:38661 (local address 127.12.116.131:39557)
0620 14:56:31.636668 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.636671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.636794 (+ 123us) server_negotiation.cc:407] Connection header received
0620 14:56:31.636911 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.636912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.636937 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.637016 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:31.637201 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.637700 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.638955 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.639172 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.639262 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.639466 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.639504 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.639568 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.639645 (+ 77us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.639670 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:56:31.639806 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.636258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39557 (local address 127.12.116.129:38661)
0620 14:56:31.636702 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.636719 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.636825 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.637023 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.637024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.637025 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:31.637105 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.637108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.637813 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.637815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.638842 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.638845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.639262 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.639263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.639337 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.639360 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.639570 (+ 210us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.639573 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.639637 (+ 64us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.639689 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":300,"threads_started":1}
I20260620 14:56:31.642601 20561 raft_consensus.cc:1261] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Refusing update from remote peer 836290e1f5c844239187a8e976504d9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.642679 20701 raft_consensus.cc:1261] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Refusing update from remote peer 836290e1f5c844239187a8e976504d9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.642925 20783 consensus_queue.cc:1035] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.643158 20806 consensus_queue.cc:1035] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.655910 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.652875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37241 (local address 127.12.116.131:52723)
0620 14:56:31.653161 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.653174 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.653258 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.653381 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.653382 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.653384 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:31.653445 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.653447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.654156 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.654157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.654988 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.654991 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.655407 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.655409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.655476 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.655510 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.655712 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.655714 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.655765 (+ 51us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.655815 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":179,"threads_started":1}
I20260620 14:56:31.655894 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.653031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:52723 (local address 127.12.116.129:37241)
0620 14:56:31.653084 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.653086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.653271 (+ 185us) server_negotiation.cc:407] Connection header received
0620 14:56:31.653316 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.653317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.653328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.653376 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:31.653496 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.654056 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.655087 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.655309 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.655407 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.655609 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.655648 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.655711 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.655768 (+ 57us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.655802 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 14:56:31.670225 20264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:31.670375 20264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:31.671494 20264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Sending DeleteTablet for 3 replicas of tablet eed2adcf47e641ceb2e7050d4c167fbd
I20260620 14:56:31.671917 20401 tablet_service.cc:1514] Processing DeleteTablet for tablet eed2adcf47e641ceb2e7050d4c167fbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:42190
I20260620 14:56:31.671969 20541 tablet_service.cc:1514] Processing DeleteTablet for tablet eed2adcf47e641ceb2e7050d4c167fbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:37798
I20260620 14:56:31.672029 20800 tablet_replica.cc:330] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: stopping tablet replica
I20260620 14:56:31.672058 20798 tablet_replica.cc:330] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: stopping tablet replica
I20260620 14:56:31.672084 20800 raft_consensus.cc:2229] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:31.672101 20798 raft_consensus.cc:2229] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:31.672138 20798 raft_consensus.cc:2258] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.672189 20800 raft_consensus.cc:2258] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.672851 20798 ts_tablet_manager.cc:1905] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.674355 20681 tablet_service.cc:1514] Processing DeleteTablet for tablet eed2adcf47e641ceb2e7050d4c167fbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:47794
I20260620 14:56:31.674496 20799 tablet_replica.cc:330] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: stopping tablet replica
I20260620 14:56:31.674594 20799 raft_consensus.cc:2229] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:31.674582 20800 ts_tablet_manager.cc:1905] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.674654 20799 raft_consensus.cc:2258] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.675010 20799 ts_tablet_manager.cc:1905] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.676632 20800 ts_tablet_manager.cc:1918] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:31.676703 20800 log.cc:1196] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/eed2adcf47e641ceb2e7050d4c167fbd
I20260620 14:56:31.676951 20800 ts_tablet_manager.cc:1939] T eed2adcf47e641ceb2e7050d4c167fbd P 836290e1f5c844239187a8e976504d9d: Deleting consensus metadata
I20260620 14:56:31.677383 20799 ts_tablet_manager.cc:1918] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:31.677444 20799 log.cc:1196] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/eed2adcf47e641ceb2e7050d4c167fbd
I20260620 14:56:31.677696 20799 ts_tablet_manager.cc:1939] T eed2adcf47e641ceb2e7050d4c167fbd P b4f4feb68cab4374a6f98418c1d6666f: Deleting consensus metadata
I20260620 14:56:31.680490 20248 catalog_manager.cc:4841] TS b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557): tablet eed2adcf47e641ceb2e7050d4c167fbd (table test-table [id=d84d0278c0954db8a745161ed093406c]) successfully deleted
I20260620 14:56:31.680644 20798 ts_tablet_manager.cc:1918] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:31.680864 20798 log.cc:1196] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/eed2adcf47e641ceb2e7050d4c167fbd
I20260620 14:56:31.681131 20798 ts_tablet_manager.cc:1939] T eed2adcf47e641ceb2e7050d4c167fbd P 6ea089969f4e4f33b422305404cf93d8: Deleting consensus metadata
I20260620 14:56:31.681599 20248 catalog_manager.cc:4841] TS 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143): tablet eed2adcf47e641ceb2e7050d4c167fbd (table test-table [id=d84d0278c0954db8a745161ed093406c]) successfully deleted
I20260620 14:56:31.681695 20248 catalog_manager.cc:4841] TS 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241): tablet eed2adcf47e641ceb2e7050d4c167fbd (table test-table [id=d84d0278c0954db8a745161ed093406c]) successfully deleted
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
W20260620 14:56:31.704838 20314 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:31.698653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39700 (local address 127.12.116.190:45237)
0620 14:56:31.698706 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.698708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.698861 (+ 153us) server_negotiation.cc:407] Connection header received
0620 14:56:31.698952 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.698953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.698965 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.699044 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.699727 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.700236 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.701063 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.701414 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.701562 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.704746 (+ 3184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39700: BlockingRecv error: recv got EOF from 127.0.0.1:39700 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Jun 20 14:56:31 dist-test-slave-7v06 krb5kdc[20219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM
I20260620 14:56:31.713753 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.705777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.12.116.190:45237)
0620 14:56:31.705830 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.705832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.706066 (+ 234us) server_negotiation.cc:407] Connection header received
0620 14:56:31.706152 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.706153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.706165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.706240 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:31.706734 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.707247 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.707958 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.708163 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.708245 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.710768 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:31.710772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:31.710772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:31.710786 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:31.712463 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.712869 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.712870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.712871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.712934 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:31.713157 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:31.713158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:31.713158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:31.713287 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:31.713403 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.713546 (+ 143us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.713641 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 14:56:31.716600 20264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:31.716837 20264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:31.718382 20681 tablet_service.cc:1467] Processing CreateTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 (DEFAULT_TABLE table=test-table [id=569aab1a4ff74635b6d5d0dec9e2e532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.718436 20401 tablet_service.cc:1467] Processing CreateTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 (DEFAULT_TABLE table=test-table [id=569aab1a4ff74635b6d5d0dec9e2e532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.718559 20401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.718559 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.720072 20780 tablet_bootstrap.cc:492] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Bootstrap starting.
I20260620 14:56:31.720180 20541 tablet_service.cc:1467] Processing CreateTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 (DEFAULT_TABLE table=test-table [id=569aab1a4ff74635b6d5d0dec9e2e532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.720363 20541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.720850 20780 tablet_bootstrap.cc:654] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.721880 20775 tablet_bootstrap.cc:492] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Bootstrap starting.
I20260620 14:56:31.721927 20776 tablet_bootstrap.cc:492] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Bootstrap starting.
I20260620 14:56:31.722278 20776 tablet_bootstrap.cc:654] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.722349 20775 tablet_bootstrap.cc:654] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.723888 20776 tablet_bootstrap.cc:492] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: No bootstrap required, opened a new log
I20260620 14:56:31.724004 20776 ts_tablet_manager.cc:1397] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:56:31.724138 20775 tablet_bootstrap.cc:492] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: No bootstrap required, opened a new log
I20260620 14:56:31.724193 20775 ts_tablet_manager.cc:1397] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:31.724244 20776 raft_consensus.cc:348] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.724402 20776 raft_consensus.cc:374] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.724426 20776 raft_consensus.cc:729] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.724475 20776 consensus_queue.cc:260] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.724470 20775 raft_consensus.cc:348] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.724545 20775 raft_consensus.cc:374] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.724568 20775 raft_consensus.cc:729] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea089969f4e4f33b422305404cf93d8, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.724607 20776 ts_tablet_manager.cc:1428] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:31.724612 20775 consensus_queue.cc:260] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.724707 20775 ts_tablet_manager.cc:1428] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 14:56:31.726264 20780 tablet_bootstrap.cc:492] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: No bootstrap required, opened a new log
I20260620 14:56:31.726367 20780 ts_tablet_manager.cc:1397] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260620 14:56:31.726586 20780 raft_consensus.cc:348] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.726719 20780 raft_consensus.cc:374] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.726749 20780 raft_consensus.cc:729] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.726811 20780 consensus_queue.cc:260] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.726922 20780 ts_tablet_manager.cc:1428] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:31.779738 20806 raft_consensus.cc:482] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:31.779856 20806 raft_consensus.cc:504] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.780014 20806 leader_election.cc:288] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143), b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.780290 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4177cb9d005a4c4ea7bcbe70bfe5ec22" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4feb68cab4374a6f98418c1d6666f" is_pre_election: true
I20260620 14:56:31.780303 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4177cb9d005a4c4ea7bcbe70bfe5ec22" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8" is_pre_election: true
I20260620 14:56:31.780418 20701 raft_consensus.cc:2454] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 0.
I20260620 14:56:31.780441 20561 raft_consensus.cc:2454] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 0.
I20260620 14:56:31.780578 20352 leader_election.cc:302] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836290e1f5c844239187a8e976504d9d, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.780694 20806 raft_consensus.cc:2781] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:31.780735 20806 raft_consensus.cc:482] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:31.780755 20806 raft_consensus.cc:3037] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.781752 20806 raft_consensus.cc:504] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.781908 20806 leader_election.cc:288] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 election: Requested vote from peers 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143), b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.782157 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4177cb9d005a4c4ea7bcbe70bfe5ec22" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4feb68cab4374a6f98418c1d6666f"
I20260620 14:56:31.782236 20701 raft_consensus.cc:3037] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.782188 20561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4177cb9d005a4c4ea7bcbe70bfe5ec22" candidate_uuid: "836290e1f5c844239187a8e976504d9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea089969f4e4f33b422305404cf93d8"
I20260620 14:56:31.782298 20561 raft_consensus.cc:3037] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.783067 20701 raft_consensus.cc:2454] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 1.
I20260620 14:56:31.783229 20561 raft_consensus.cc:2454] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836290e1f5c844239187a8e976504d9d in term 1.
I20260620 14:56:31.783295 20352 leader_election.cc:302] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836290e1f5c844239187a8e976504d9d, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.783380 20806 raft_consensus.cc:2781] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:31.783416 20806 raft_consensus.cc:686] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 1 LEADER]: Becoming Leader. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Running, Role: LEADER
I20260620 14:56:31.783459 20806 consensus_queue.cc:237] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.784083 20264 catalog_manager.cc:5495] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 836290e1f5c844239187a8e976504d9d (127.12.116.129). New cstate: current_term: 1 leader_uuid: "836290e1f5c844239187a8e976504d9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:31.804534 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.801678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42202 (local address 127.12.116.129:37241)
0620 14:56:31.801723 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.801725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.801748 (+ 23us) server_negotiation.cc:407] Connection header received
0620 14:56:31.801816 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.801817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.801827 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.801894 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:31.802085 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.802582 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.803763 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.803988 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.804055 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.804232 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:31.804260 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:31.804297 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.804421 (+ 124us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.804453 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 14:56:31.805500 20701 raft_consensus.cc:1261] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Refusing update from remote peer 836290e1f5c844239187a8e976504d9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.805552 20561 raft_consensus.cc:1261] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Refusing update from remote peer 836290e1f5c844239187a8e976504d9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:31.805886 20806 consensus_queue.cc:1035] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.806053 20783 consensus_queue.cc:1035] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:31.808806 20264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:31.808915 20264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:31.809849 20264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Sending DeleteTablet for 3 replicas of tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22
I20260620 14:56:31.810333 20681 tablet_service.cc:1514] Processing DeleteTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:47794
I20260620 14:56:31.810456 20799 tablet_replica.cc:330] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: stopping tablet replica
I20260620 14:56:31.810442 20401 tablet_service.cc:1514] Processing DeleteTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:42190
I20260620 14:56:31.810510 20799 raft_consensus.cc:2229] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:31.810544 20680 tablet_service.cc:1514] Processing DeleteTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:47794
I20260620 14:56:31.810653 20541 tablet_service.cc:1514] Processing DeleteTablet for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:31 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:37798
I20260620 14:56:31.810778 20800 tablet_replica.cc:330] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: stopping tablet replica
I20260620 14:56:31.810842 20800 raft_consensus.cc:2229] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:31.810909 20800 raft_consensus.cc:2258] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.810981 20798 tablet_replica.cc:330] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: stopping tablet replica
I20260620 14:56:31.811036 20798 raft_consensus.cc:2229] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:31.811090 20798 raft_consensus.cc:2258] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.811292 20263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:31.811460 20263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:31.810576 20799 raft_consensus.cc:2258] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:31.812410 20800 ts_tablet_manager.cc:1905] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.814206 20800 ts_tablet_manager.cc:1918] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:31.814286 20800 log.cc:1196] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/4177cb9d005a4c4ea7bcbe70bfe5ec22
I20260620 14:56:31.814534 20800 ts_tablet_manager.cc:1939] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 836290e1f5c844239187a8e976504d9d: Deleting consensus metadata
I20260620 14:56:31.815084 20798 ts_tablet_manager.cc:1905] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.816828 20799 ts_tablet_manager.cc:1905] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:31.816979 20798 ts_tablet_manager.cc:1918] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:31.817065 20798 log.cc:1196] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/4177cb9d005a4c4ea7bcbe70bfe5ec22
I20260620 14:56:31.817289 20798 ts_tablet_manager.cc:1939] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P 6ea089969f4e4f33b422305404cf93d8: Deleting consensus metadata
I20260620 14:56:31.817946 20248 catalog_manager.cc:4841] TS 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143): tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 (table test-table [id=569aab1a4ff74635b6d5d0dec9e2e532]) successfully deleted
I20260620 14:56:31.818571 20799 ts_tablet_manager.cc:1918] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:31.818639 20799 log.cc:1196] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/4177cb9d005a4c4ea7bcbe70bfe5ec22
I20260620 14:56:31.818864 20799 ts_tablet_manager.cc:1939] T 4177cb9d005a4c4ea7bcbe70bfe5ec22 P b4f4feb68cab4374a6f98418c1d6666f: Deleting consensus metadata
I20260620 14:56:31.818981 20248 catalog_manager.cc:4841] TS 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241): tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 (table test-table [id=569aab1a4ff74635b6d5d0dec9e2e532]) successfully deleted
I20260620 14:56:31.819291 20401 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3ec2f0a12f4c6a8415d293b85705f7 (DEFAULT_TABLE table=test-table [id=067264fb5bdd4a30aa3a2ceb0dd1cadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.819308 20680 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3ec2f0a12f4c6a8415d293b85705f7 (DEFAULT_TABLE table=test-table [id=067264fb5bdd4a30aa3a2ceb0dd1cadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.819432 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3ec2f0a12f4c6a8415d293b85705f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.819435 20401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3ec2f0a12f4c6a8415d293b85705f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.820581 20780 tablet_bootstrap.cc:492] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: Bootstrap starting.
I20260620 14:56:31.820955 20541 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3ec2f0a12f4c6a8415d293b85705f7 (DEFAULT_TABLE table=test-table [id=067264fb5bdd4a30aa3a2ceb0dd1cadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:31.821071 20780 tablet_bootstrap.cc:654] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.821084 20541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3ec2f0a12f4c6a8415d293b85705f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:31.821763 20780 tablet_bootstrap.cc:492] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: No bootstrap required, opened a new log
I20260620 14:56:31.821810 20780 ts_tablet_manager.cc:1397] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:31.821982 20780 raft_consensus.cc:348] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.822068 20780 raft_consensus.cc:374] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.822090 20780 raft_consensus.cc:729] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836290e1f5c844239187a8e976504d9d, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.822333 20776 tablet_bootstrap.cc:492] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Bootstrap starting.
I20260620 14:56:31.822315 20780 consensus_queue.cc:260] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.822474 20780 ts_tablet_manager.cc:1428] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:31.822712 20776 tablet_bootstrap.cc:654] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.822861 20775 tablet_bootstrap.cc:492] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Bootstrap starting.
I20260620 14:56:31.823328 20775 tablet_bootstrap.cc:654] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:31.823740 20248 catalog_manager.cc:4841] TS b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557): tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 (table test-table [id=569aab1a4ff74635b6d5d0dec9e2e532]) successfully deleted
W20260620 14:56:31.823920 20248 catalog_manager.cc:4808] TS b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557): delete failed for tablet 4177cb9d005a4c4ea7bcbe70bfe5ec22 because the tablet was not found. No further retry: Not found: Tablet not found: 4177cb9d005a4c4ea7bcbe70bfe5ec22
I20260620 14:56:31.824391 20776 tablet_bootstrap.cc:492] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: No bootstrap required, opened a new log
I20260620 14:56:31.824494 20776 ts_tablet_manager.cc:1397] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:31.824674 20776 raft_consensus.cc:348] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.824797 20776 raft_consensus.cc:374] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.824780 20775 tablet_bootstrap.cc:492] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: No bootstrap required, opened a new log
I20260620 14:56:31.824837 20776 raft_consensus.cc:729] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f4feb68cab4374a6f98418c1d6666f, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.824867 20775 ts_tablet_manager.cc:1397] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:31.824929 20776 consensus_queue.cc:260] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.825050 20776 ts_tablet_manager.cc:1428] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:31.825062 20775 raft_consensus.cc:348] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.825192 20775 raft_consensus.cc:374] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:31.825218 20775 raft_consensus.cc:729] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea089969f4e4f33b422305404cf93d8, State: Initialized, Role: FOLLOWER
I20260620 14:56:31.825289 20775 consensus_queue.cc:260] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.825409 20775 ts_tablet_manager.cc:1428] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:31.961453 20779 raft_consensus.cc:482] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:31.961603 20779 raft_consensus.cc:504] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.962034 20779 leader_election.cc:288] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241), b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.966313 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.962736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39557 (local address 127.12.116.130:45945)
0620 14:56:31.962853 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.962864 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.962921 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.963139 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.963141 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.963143 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.963200 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.963202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.963923 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.963924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.964962 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.964966 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.965881 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.965883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.965994 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.966000 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.966142 (+ 142us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.966202 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":38,"threads_started":1}
I20260620 14:56:31.966382 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.962864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:45945 (local address 127.12.116.131:39557)
0620 14:56:31.962937 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.962939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.962948 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:31.962987 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.962988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.962997 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.963046 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.963273 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.963796 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.965127 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.965792 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.965867 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.965877 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.966227 (+ 350us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.966297 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260620 14:56:31.966725 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3ec2f0a12f4c6a8415d293b85705f7" candidate_uuid: "6ea089969f4e4f33b422305404cf93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4feb68cab4374a6f98418c1d6666f" is_pre_election: true
I20260620 14:56:31.966861 20701 raft_consensus.cc:2454] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ea089969f4e4f33b422305404cf93d8 in term 0.
I20260620 14:56:31.966902 20854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.962536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37241 (local address 127.12.116.130:42013)
0620 14:56:31.962713 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:31.962729 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:31.962850 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:31.963187 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:31.963188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:31.963190 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:31.963283 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.963285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.964478 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.964481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.965652 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:31.965655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.966570 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.966571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:31.966658 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.966663 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:56:31.966759 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 14:56:31.966805 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":86,"threads_started":1}
I20260620 14:56:31.966893 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:31.962673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:42013 (local address 127.12.116.129:37241)
0620 14:56:31.962733 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:31.962736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:31.962831 (+ 95us) server_negotiation.cc:407] Connection header received
0620 14:56:31.963102 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:31.963103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:31.963111 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:31.963180 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:31.963448 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.964237 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.965821 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:31.966486 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:31.966565 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:31.966576 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:31.966783 (+ 207us) server_negotiation.cc:299] Negotiation successful
0620 14:56:31.966828 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 14:56:31.967093 20492 leader_election.cc:302] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea089969f4e4f33b422305404cf93d8, b4f4feb68cab4374a6f98418c1d6666f; no voters:
I20260620 14:56:31.967242 20779 raft_consensus.cc:2781] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:31.967289 20779 raft_consensus.cc:482] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:31.967314 20779 raft_consensus.cc:3037] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.967411 20421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3ec2f0a12f4c6a8415d293b85705f7" candidate_uuid: "6ea089969f4e4f33b422305404cf93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836290e1f5c844239187a8e976504d9d" is_pre_election: true
I20260620 14:56:31.967514 20421 raft_consensus.cc:2454] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ea089969f4e4f33b422305404cf93d8 in term 0.
I20260620 14:56:31.968492 20779 raft_consensus.cc:504] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.968683 20779 leader_election.cc:288] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241), b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557)
I20260620 14:56:31.968851 20421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3ec2f0a12f4c6a8415d293b85705f7" candidate_uuid: "6ea089969f4e4f33b422305404cf93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836290e1f5c844239187a8e976504d9d"
I20260620 14:56:31.968909 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3ec2f0a12f4c6a8415d293b85705f7" candidate_uuid: "6ea089969f4e4f33b422305404cf93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4feb68cab4374a6f98418c1d6666f"
I20260620 14:56:31.968976 20421 raft_consensus.cc:3037] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.969025 20701 raft_consensus.cc:3037] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:31.969668 20421 raft_consensus.cc:2454] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea089969f4e4f33b422305404cf93d8 in term 1.
I20260620 14:56:31.969868 20701 raft_consensus.cc:2454] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea089969f4e4f33b422305404cf93d8 in term 1.
I20260620 14:56:31.969959 20492 leader_election.cc:302] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea089969f4e4f33b422305404cf93d8, 836290e1f5c844239187a8e976504d9d; no voters:
I20260620 14:56:31.970093 20779 raft_consensus.cc:2781] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:31.970233 20779 raft_consensus.cc:686] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 6ea089969f4e4f33b422305404cf93d8, State: Running, Role: LEADER
I20260620 14:56:31.970319 20779 consensus_queue.cc:237] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } }
I20260620 14:56:31.971148 20263 catalog_manager.cc:5495] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6ea089969f4e4f33b422305404cf93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ea089969f4e4f33b422305404cf93d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 } health_report { overall_health: UNKNOWN } } }
I20260620 14:56:32.013372 20858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:32.009735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.12.116.130:44143)
0620 14:56:32.010046 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:32.010048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:32.010058 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:32.010100 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:32.010100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:32.010122 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:32.010299 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:32.010524 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.011182 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.012107 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.012414 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.012502 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:32.012824 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:32.012954 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:32.013041 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:32.013246 (+ 205us) server_negotiation.cc:299] Negotiation successful
0620 14:56:32.013271 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":255,"threads_started":1}
I20260620 14:56:32.021265 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:32.017318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39557 (local address 127.12.116.130:32869)
0620 14:56:32.017607 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:32.017620 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:32.017711 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:32.018043 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:32.018044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:32.018047 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:32.018151 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:32.018153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.019069 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.019071 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:32.020017 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:32.020021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.020595 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.020597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:32.020679 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:32.020706 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:32.021043 (+ 337us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:32.021046 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:32.021115 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 14:56:32.021169 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":154,"threads_started":1}
I20260620 14:56:32.021252 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:32.017445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:32869 (local address 127.12.116.131:39557)
0620 14:56:32.017531 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:32.017533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:32.017813 (+ 280us) server_negotiation.cc:407] Connection header received
0620 14:56:32.017858 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:32.017859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:32.017876 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:32.017968 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:32.018302 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.018862 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.020155 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.020455 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.020527 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:32.020852 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:32.020890 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:32.020964 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:32.021158 (+ 194us) server_negotiation.cc:299] Negotiation successful
0620 14:56:32.021188 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260620 14:56:32.024887 20421 raft_consensus.cc:1261] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Refusing update from remote peer 6ea089969f4e4f33b422305404cf93d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:32.024904 20701 raft_consensus.cc:1261] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Refusing update from remote peer 6ea089969f4e4f33b422305404cf93d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:32.025235 20856 consensus_queue.cc:1035] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836290e1f5c844239187a8e976504d9d" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:32.025408 20779 consensus_queue.cc:1035] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4f4feb68cab4374a6f98418c1d6666f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:32.037657 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:32.034082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44143 (local address 127.12.116.131:38331)
0620 14:56:32.034127 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:32.034146 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:32.034202 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:32.034480 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:32.034481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:32.034483 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 14:56:32.034539 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:32.034541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.035506 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.035508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:32.036233 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:32.036235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.036918 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.036920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:32.036971 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:32.036979 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 14:56:32.037333 (+ 354us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 14:56:32.037336 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:32.037436 (+ 100us) client_negotiation.cc:240] Negotiation successful
0620 14:56:32.037500 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260620 14:56:32.037628 20858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:32.034223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:38331 (local address 127.12.116.130:44143)
0620 14:56:32.034269 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:32.034271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:32.034281 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:32.034333 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:32.034333 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:32.034345 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:32.034396 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:32.034602 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.035182 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.036582 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:32.036788 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:32.036857 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:32.037123 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:32.037158 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:32.037227 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:32.037441 (+ 214us) server_negotiation.cc:299] Negotiation successful
0620 14:56:32.037471 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:56:32.056711 20264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:32.057014 20264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:32.058240 20264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74ffdca82d134dc6b2155982b8ef8977: Sending DeleteTablet for 3 replicas of tablet 1e3ec2f0a12f4c6a8415d293b85705f7
I20260620 14:56:32.058720 20401 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3ec2f0a12f4c6a8415d293b85705f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:32 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:42190
I20260620 14:56:32.058842 20800 tablet_replica.cc:330] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: stopping tablet replica
I20260620 14:56:32.058892 20800 raft_consensus.cc:2229] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:32.058934 20800 raft_consensus.cc:2258] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:32.058923 20541 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3ec2f0a12f4c6a8415d293b85705f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:32 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:37798
I20260620 14:56:32.059048 20798 tablet_replica.cc:330] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: stopping tablet replica
I20260620 14:56:32.059099 20680 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3ec2f0a12f4c6a8415d293b85705f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:32 UTC) from {username='oryx', principal='oryx/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:47794
I20260620 14:56:32.059191 20799 tablet_replica.cc:330] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: stopping tablet replica
I20260620 14:56:32.059247 20799 raft_consensus.cc:2229] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:32.059100 20798 raft_consensus.cc:2229] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:32.059299 20799 raft_consensus.cc:2258] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:32.060182 20799 ts_tablet_manager.cc:1905] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:32.060750 20798 raft_consensus.cc:2258] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:32.061252 20800 ts_tablet_manager.cc:1905] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 836290e1f5c844239187a8e976504d9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:32.061295 20798 ts_tablet_manager.cc:1905] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:32.063017 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 20336
I20260620 14:56:32.070350 20799 ts_tablet_manager.cc:1918] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:32.070494 20799 log.cc:1196] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/1e3ec2f0a12f4c6a8415d293b85705f7
I20260620 14:56:32.071031 20799 ts_tablet_manager.cc:1939] T 1e3ec2f0a12f4c6a8415d293b85705f7 P b4f4feb68cab4374a6f98418c1d6666f: Deleting consensus metadata
I20260620 14:56:32.071689 20798 ts_tablet_manager.cc:1918] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 14:56:32.071789 20798 log.cc:1196] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/1e3ec2f0a12f4c6a8415d293b85705f7
I20260620 14:56:32.071707 20248 catalog_manager.cc:4841] TS b4f4feb68cab4374a6f98418c1d6666f (127.12.116.131:39557): tablet 1e3ec2f0a12f4c6a8415d293b85705f7 (table test-table [id=067264fb5bdd4a30aa3a2ceb0dd1cadb]) successfully deleted
I20260620 14:56:32.072072 20798 ts_tablet_manager.cc:1939] T 1e3ec2f0a12f4c6a8415d293b85705f7 P 6ea089969f4e4f33b422305404cf93d8: Deleting consensus metadata
I20260620 14:56:32.072602 20248 catalog_manager.cc:4841] TS 6ea089969f4e4f33b422305404cf93d8 (127.12.116.130:44143): tablet 1e3ec2f0a12f4c6a8415d293b85705f7 (table test-table [id=067264fb5bdd4a30aa3a2ceb0dd1cadb]) successfully deleted
W20260620 14:56:32.073447 20248 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:37241 (error 108)
W20260620 14:56:32.074616 20867 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:32.074203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37241 (local address 127.0.0.1:42212)
0620 14:56:32.074393 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:32.074407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:32.074475 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:32.074558 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:37241: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":55,"threads_started":1}
W20260620 14:56:32.074872 20248 catalog_manager.cc:4584] TS 836290e1f5c844239187a8e976504d9d (127.12.116.129:37241): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1e3ec2f0a12f4c6a8415d293b85705f7: Network error: Client connection negotiation failed: client connection to 127.12.116.129:37241: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260620 14:56:32.075264 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 20476
I20260620 14:56:32.085421 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 20616
I20260620 14:56:32.093636 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 20232
2026-06-20T14:56:32Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3193 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:32 dist-test-slave-7v06 krb5kdc[20870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:32 dist-test-slave-7v06 krb5kdc[20870](info): set up 2 sockets
Jun 20 14:56:32 dist-test-slave-7v06 krb5kdc[20870](info): commencing operation
krb5kdc: starting...
W20260620 14:56:33.241235 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:33 dist-test-slave-7v06 krb5kdc[20870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:33.397650 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36505
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:33.500564 20883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:33.500908 20883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:33.501156 20883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:33.504268 20883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:33.504451 20883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:33.504483 20883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:33.504510 20883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:33.504544 20883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:33.507562 20883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:33.508134 20883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:33.508517 20883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:33.514843 20888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:33.515374 20891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:33.515514 20889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:33.516817 20883 server_base.cc:1034] running on GCE node
I20260620 14:56:33.517143 20883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:33.517477 20883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:33.518991 20883 hybrid_clock.cc:648] HybridClock initialized: now 1781967393518971 us; error 54 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-06-20T14:56:33Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1430 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:33 dist-test-slave-7v06 krb5kdc[20896](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:33 dist-test-slave-7v06 krb5kdc[20896](info): set up 2 sockets
Jun 20 14:56:33 dist-test-slave-7v06 krb5kdc[20896](info): commencing operation
krb5kdc: starting...
W20260620 14:56:34.641311 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:34 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:34.780894 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40599
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:40599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:34.871872 20909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:34.872133 20909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:34.872159 20909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:34.873458 20909 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:34.873522 20909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:34.873538 20909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:34.873553 20909 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:34.873565 20909 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:34.875195 20909 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:40599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:34.875451 20909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:34.875661 20909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:34.881881 20915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:34.881942 20914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:34.882038 20917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:34.882416 20909 server_base.cc:1034] running on GCE node
I20260620 14:56:34.882912 20909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:34.883307 20909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:34.884514 20909 hybrid_clock.cc:648] HybridClock initialized: now 1781967394884480 us; error 56 us; skew 500 ppm
Jun 20 14:56:34 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967394, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:34.887494 20909 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:34.888099 20909 webserver.cc:460] Webserver started at http://127.12.116.190:43927/ using document root <none> and password file <none>
I20260620 14:56:34.888438 20909 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:34.888515 20909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:34.888685 20909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:34.889889 20909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "6f1998925069408e88c29ca462c5745a"
format_stamp: "Formatted at 2026-06-20 14:56:34 on dist-test-slave-7v06"
server_key: "e3399e96022b8f1fc316ab4dea1d5a01"
server_key_iv: "c8e7772cd98d0b1326ab354eb87ee21c"
server_key_version: "encryptionkey@0"
I20260620 14:56:34.890327 20909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "6f1998925069408e88c29ca462c5745a"
format_stamp: "Formatted at 2026-06-20 14:56:34 on dist-test-slave-7v06"
server_key: "e3399e96022b8f1fc316ab4dea1d5a01"
server_key_iv: "c8e7772cd98d0b1326ab354eb87ee21c"
server_key_version: "encryptionkey@0"
I20260620 14:56:34.892122 20909 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:34.893198 20924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:34.893482 20909 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:34.893604 20909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "6f1998925069408e88c29ca462c5745a"
format_stamp: "Formatted at 2026-06-20 14:56:34 on dist-test-slave-7v06"
server_key: "e3399e96022b8f1fc316ab4dea1d5a01"
server_key_iv: "c8e7772cd98d0b1326ab354eb87ee21c"
server_key_version: "encryptionkey@0"
I20260620 14:56:34.893736 20909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:34.921238 20909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:34.924585 20909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:34.924829 20909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:34.930199 20909 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:40599
I20260620 14:56:34.930227 20976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:40599 every 8 connection(s)
I20260620 14:56:34.930696 20909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:34.931739 20977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:34.934429 20977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Bootstrap starting.
I20260620 14:56:34.935385 20977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:34.935771 20977 log.cc:824] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:34.936888 20977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: No bootstrap required, opened a new log
I20260620 14:56:34.937238 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 20909
I20260620 14:56:34.937355 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:34.937556 12754 external_mini_cluster.cc:1428] Setting key c913b4bc2801a535e93c8167c037702b
I20260620 14:56:34.939388 20977 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:34.939610 20977 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:34.939654 20977 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1998925069408e88c29ca462c5745a, State: Initialized, Role: FOLLOWER
I20260620 14:56:34.939816 20977 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:34.939913 20977 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:34.939957 20977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:34.940014 20977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:34.941193 20977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:34.941301 20977 leader_election.cc:302] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f1998925069408e88c29ca462c5745a; no voters:
I20260620 14:56:34.941510 20977 leader_election.cc:288] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:34.941568 20982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:34.941746 20982 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 LEADER]: Becoming Leader. State: Replica: 6f1998925069408e88c29ca462c5745a, State: Running, Role: LEADER
I20260620 14:56:34.941820 20977 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:34.941856 20982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:34.942282 20982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f1998925069408e88c29ca462c5745a. Latest consensus state: current_term: 1 leader_uuid: "6f1998925069408e88c29ca462c5745a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } } }
I20260620 14:56:34.942370 20982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:34.942291 20983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f1998925069408e88c29ca462c5745a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } } }
I20260620 14:56:34.942539 20983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: This master's current role is: LEADER
W20260620 14:56:34.943735 20997 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:56:34.943812 20997 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:56:34.943879 20989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:34.944034 20989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:34.946009 20989 catalog_manager.cc:1347] Generated new cluster ID: 1f3ac3d4b88b46b4bc3b1ed1e534892f
I20260620 14:56:34.946074 20989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:56:34 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:34.951750 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:34.938360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55266 (local address 127.12.116.190:40599)
0620 14:56:34.938596 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:34.938607 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:34.938644 (+ 37us) server_negotiation.cc:407] Connection header received
0620 14:56:34.939362 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:34.939370 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:34.939440 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:34.939581 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:34.940475 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:34.941624 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:34.942805 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:34.943598 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:34.943759 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:34.947027 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:34.947032 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:34.947033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:34.947046 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:34.949705 (+ 2659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:34.950262 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:34.950266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:34.950266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:34.950417 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:34.950689 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:34.950690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:34.950690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:34.951048 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:34.951232 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:34.951360 (+ 128us) server_negotiation.cc:299] Negotiation successful
0620 14:56:34.951525 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":132,"threads_started":1}
I20260620 14:56:34.956970 20989 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:34.957589 20989 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:34.967952 20989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Generated new TSK 0
I20260620 14:56:34.968200 20989 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:35.015174 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40599
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:35.124109 21003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:35.124928 21003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:35.125159 21003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:35.127172 21003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:35.127293 21003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:35.127362 21003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:35.132299 21003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:35.132715 21003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:35.133008 21003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:35.139668 21009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.139780 21008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.139851 21011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:35.140074 21003 server_base.cc:1034] running on GCE node
I20260620 14:56:35.140508 21003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:35.140843 21003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:35.142043 21003 hybrid_clock.cc:648] HybridClock initialized: now 1781967395141998 us; error 59 us; skew 500 ppm
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:35.146139 21003 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:35.146750 21003 webserver.cc:460] Webserver started at http://127.12.116.129:41329/ using document root <none> and password file <none>
I20260620 14:56:35.147014 21003 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:35.147198 21003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:35.147485 21003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:35.149091 21003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "04843921709043a4bbd838305c75edc0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "988e51392c8b7554452959135573b582"
server_key_iv: "ba53a6223e97f4032dc513f0d8d98bd2"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.149712 21003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "04843921709043a4bbd838305c75edc0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "988e51392c8b7554452959135573b582"
server_key_iv: "ba53a6223e97f4032dc513f0d8d98bd2"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.153312 21003 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260620 14:56:35.156428 21018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.156690 21003 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.001s
I20260620 14:56:35.156942 21003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "04843921709043a4bbd838305c75edc0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "988e51392c8b7554452959135573b582"
server_key_iv: "ba53a6223e97f4032dc513f0d8d98bd2"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.157066 21003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:35.176609 21003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:35.179188 21003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:35.179322 21003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:35.179533 21003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:35.179886 21003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:35.179940 21003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.179975 21003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:35.180006 21003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.186313 21003 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40291
I20260620 14:56:35.186352 21131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40291 every 8 connection(s)
I20260620 14:56:35.186753 21003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:35.193887 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21003
I20260620 14:56:35.194022 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:35.194180 12754 external_mini_cluster.cc:1428] Setting key b2a47b1306a15f7e6f0373397f599fa8
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:35.202205 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:35.187660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:44373 (local address 127.12.116.190:40599)
0620 14:56:35.187788 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:35.187790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:35.187981 (+ 191us) server_negotiation.cc:407] Connection header received
0620 14:56:35.188555 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:35.188557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:35.188573 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:35.188657 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:35.189963 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.190713 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.193426 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.193743 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.193852 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:35.198822 (+ 4970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:35.198824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:35.198824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:35.198838 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:35.200574 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:35.201096 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:35.201103 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:35.201103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:35.201158 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:35.201450 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:35.201451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:35.201451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:35.201582 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:35.201655 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:35.201978 (+ 323us) server_negotiation.cc:299] Negotiation successful
0620 14:56:35.202091 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260620 14:56:35.202414 21134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:35.187574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:44373)
0620 14:56:35.187803 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:35.187853 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:35.188434 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:35.188769 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:35.188773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:35.189497 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:35.189730 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:35.189737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.191134 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.191136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:35.193222 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:35.193232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.194148 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.194156 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:35.194566 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:35.196268 (+ 1702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:35.196280 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:35.198667 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:35.200692 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:35.200705 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:35.200708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:35.200999 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:35.201240 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:35.201241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:35.201241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:35.201368 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:35.201656 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:35.201665 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:35.201834 (+ 169us) client_negotiation.cc:769] Sending connection context
0620 14:56:35.201944 (+ 110us) client_negotiation.cc:240] Negotiation successful
0620 14:56:35.202131 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":116,"threads_started":1}
I20260620 14:56:35.202908 21132 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40599
I20260620 14:56:35.203003 21132 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:35.203202 21132 heartbeater.cc:511] Master 127.12.116.190:40599 requested a full tablet report, sending...
I20260620 14:56:35.203770 20941 ts_manager.cc:194] Registered new tserver with Master: 04843921709043a4bbd838305c75edc0 (127.12.116.129:40291)
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:56:35.205018 20941 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:44373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:35.229535 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40599
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:35.328493 21137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:35.328739 21137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:35.328768 21137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:35.330127 21137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:35.330202 21137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:35.330235 21137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:35.332684 21137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:35.333027 21137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:35.333307 21137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:35.339978 21142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.340030 21145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.340373 21143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:35.340268 21137 server_base.cc:1034] running on GCE node
I20260620 14:56:35.340662 21137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:35.340914 21137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:35.342060 21137 hybrid_clock.cc:648] HybridClock initialized: now 1781967395342020 us; error 65 us; skew 500 ppm
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:35.348462 21137 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:35.349150 21137 webserver.cc:460] Webserver started at http://127.12.116.130:36067/ using document root <none> and password file <none>
I20260620 14:56:35.349409 21137 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:35.349473 21137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:35.349575 21137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:35.350823 21137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "b940de6af3854d0baef556e975d1a1f0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "6d4461bae37461043504c548d6fe4afe"
server_key_iv: "6f52b6cc0549b0348791db0daa164253"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.351239 21137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "b940de6af3854d0baef556e975d1a1f0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "6d4461bae37461043504c548d6fe4afe"
server_key_iv: "6f52b6cc0549b0348791db0daa164253"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.353545 21137 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:56:35.354909 21152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.355276 21137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:35.355435 21137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "b940de6af3854d0baef556e975d1a1f0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "6d4461bae37461043504c548d6fe4afe"
server_key_iv: "6f52b6cc0549b0348791db0daa164253"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.355548 21137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:35.373916 21137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:35.377337 21137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:35.377593 21137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:35.378054 21137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:35.378610 21137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:35.378654 21137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.378682 21137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:35.378696 21137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.387522 21137 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:40305
I20260620 14:56:35.387682 21265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:40305 every 8 connection(s)
I20260620 14:56:35.388201 21137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:35.396133 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21137
I20260620 14:56:35.396248 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:35.396555 12754 external_mini_cluster.cc:1428] Setting key 476e4b90c95e4b2e1f2eef62fcd460d4
I20260620 14:56:35.399701 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:35.389499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:47745 (local address 127.12.116.190:40599)
0620 14:56:35.389652 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:35.389654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:35.389864 (+ 210us) server_negotiation.cc:407] Connection header received
0620 14:56:35.390418 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:35.390419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:35.390432 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:35.390488 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:35.391594 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.392161 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.393333 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.393542 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.393621 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:35.396497 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:35.396500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:35.396500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:35.396510 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:35.398176 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:35.398632 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:35.398634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:35.398634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:35.398701 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:35.398973 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:35.398974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:35.398974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:35.399103 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:35.399176 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:35.399482 (+ 306us) server_negotiation.cc:299] Negotiation successful
0620 14:56:35.399583 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260620 14:56:35.399976 21268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:35.389348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:47745)
0620 14:56:35.389700 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:35.389744 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:35.390292 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:35.390586 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:35.390591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:35.391242 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:35.391474 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:35.391480 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.392266 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.392267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:35.393216 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:35.393219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.393627 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.393629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:35.393768 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:35.394356 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:35.394364 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:35.396309 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:35.398263 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:35.398273 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:35.398275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:35.398547 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:35.398770 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:35.398770 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:35.398771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:35.398902 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:35.399181 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:35.399187 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:35.399348 (+ 161us) client_negotiation.cc:769] Sending connection context
0620 14:56:35.399462 (+ 114us) client_negotiation.cc:240] Negotiation successful
0620 14:56:35.399687 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":192,"threads_started":1}
I20260620 14:56:35.401027 21266 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40599
I20260620 14:56:35.401278 21266 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:35.401628 21266 heartbeater.cc:511] Master 127.12.116.190:40599 requested a full tablet report, sending...
I20260620 14:56:35.402240 20941 ts_manager.cc:194] Registered new tserver with Master: b940de6af3854d0baef556e975d1a1f0 (127.12.116.130:40305)
I20260620 14:56:35.402806 20941 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:47745
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:35.430073 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40599
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:35.528908 21271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:35.529376 21271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:35.529414 21271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:35.531673 21271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:35.531791 21271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:35.531841 21271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:35.534435 21271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:35.534749 21271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:35.535115 21271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:35.541594 21277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.541595 21276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.541594 21279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:35.542169 21271 server_base.cc:1034] running on GCE node
I20260620 14:56:35.542541 21271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:35.542873 21271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:35.544056 21271 hybrid_clock.cc:648] HybridClock initialized: now 1781967395544045 us; error 36 us; skew 500 ppm
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:35.547389 21271 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:35.547935 21271 webserver.cc:460] Webserver started at http://127.12.116.131:33517/ using document root <none> and password file <none>
I20260620 14:56:35.548228 21271 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:35.548280 21271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:35.548454 21271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:35.549661 21271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "52f8f7cb0195475199ec9e13a6720cfd"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "9d481054d50dcca39a8561bdd0203c40"
server_key_iv: "dc63cf724cc12e432d8ba524844150a6"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.550112 21271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "52f8f7cb0195475199ec9e13a6720cfd"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "9d481054d50dcca39a8561bdd0203c40"
server_key_iv: "dc63cf724cc12e432d8ba524844150a6"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.551781 21271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:35.552994 21286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.553381 21271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:35.553529 21271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "52f8f7cb0195475199ec9e13a6720cfd"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "9d481054d50dcca39a8561bdd0203c40"
server_key_iv: "dc63cf724cc12e432d8ba524844150a6"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.553769 21271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:35.578662 21271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:35.581908 21271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:35.582193 21271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:35.582823 21271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:35.583252 21271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:35.583317 21271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.583355 21271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:35.583384 21271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.590811 21271 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:43029
I20260620 14:56:35.590862 21399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:43029 every 8 connection(s)
I20260620 14:56:35.591244 21271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:35.597190 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21271
I20260620 14:56:35.597332 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:35.597760 12754 external_mini_cluster.cc:1428] Setting key b7623a7eff27e689b0af4b97fa0a166a
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:35.606609 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:35.592233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:60915 (local address 127.12.116.190:40599)
0620 14:56:35.592407 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:35.592413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:35.592803 (+ 390us) server_negotiation.cc:407] Connection header received
0620 14:56:35.593287 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:35.593289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:35.593305 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:35.593387 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:35.594597 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.595181 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.596948 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.597319 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.597441 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:35.602461 (+ 5020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:35.602463 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:35.602464 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:35.602481 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:35.604831 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:35.605423 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:35.605425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:35.605426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:35.605498 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:35.605815 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:35.605816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:35.605816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:35.605961 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:35.606052 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:35.606395 (+ 343us) server_negotiation.cc:299] Negotiation successful
0620 14:56:35.606498 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260620 14:56:35.606866 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:35.592201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:60915)
0620 14:56:35.592520 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:35.592590 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:35.593157 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:35.593452 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:35.593456 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:35.594163 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:35.594431 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:35.594438 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.595338 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.595340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:35.596620 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:35.596626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:35.597711 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:35.597713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:35.597958 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:35.599256 (+ 1298us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:35.599269 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:35.602290 (+ 3021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:35.604963 (+ 2673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:35.604981 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:35.604984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:35.605312 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:35.605588 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:35.605591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:35.605591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:35.605719 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:35.606040 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:35.606048 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:35.606228 (+ 180us) client_negotiation.cc:769] Sending connection context
0620 14:56:35.606356 (+ 128us) client_negotiation.cc:240] Negotiation successful
0620 14:56:35.606570 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":210,"threads_started":1}
I20260620 14:56:35.607977 21400 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40599
I20260620 14:56:35.608217 21400 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:35.608508 21400 heartbeater.cc:511] Master 127.12.116.190:40599 requested a full tablet report, sending...
I20260620 14:56:35.609371 20941 ts_manager.cc:194] Registered new tserver with Master: 52f8f7cb0195475199ec9e13a6720cfd (127.12.116.131:43029)
I20260620 14:56:35.609864 20941 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:60915
I20260620 14:56:35.611721 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab.
Entry for principal oryx/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab.
WARNING: no policy specified for oryx/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab.
Entry for principal oryx/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab.
WARNING: no policy specified for oryx/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab.
Entry for principal oryx/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab.
I20260620 14:56:35.709822 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21003
I20260620 14:56:35.714890 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21137
I20260620 14:56:35.721616 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21271
I20260620 14:56:35.726270 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 20909
I20260620 14:56:35.732125 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40599
--webserver_interface=127.12.116.190
--webserver_port=43927
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:40599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:35.826795 21409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:35.827092 21409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:35.827121 21409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:35.828806 21409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:35.829082 21409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:35.829119 21409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:35.829137 21409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:35.829200 21409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:35.831534 21409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:40599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=43927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:35.832182 21409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:35.832614 21409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:56:35.839524 21409 server_base.cc:1034] running on GCE node
W20260620 14:56:35.839339 21417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.839349 21414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:35.839339 21415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:35.840270 21409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:35.840709 21409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:35.841892 21409 hybrid_clock.cc:648] HybridClock initialized: now 1781967395841850 us; error 72 us; skew 500 ppm
Jun 20 14:56:35 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:35.845180 21409 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:35.845708 21409 webserver.cc:460] Webserver started at http://127.12.116.190:43927/ using document root <none> and password file <none>
I20260620 14:56:35.845997 21409 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:35.846097 21409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:35.847924 21409 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260620 14:56:35.849027 21424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:35.849517 21409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:35.849692 21409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "6f1998925069408e88c29ca462c5745a"
format_stamp: "Formatted at 2026-06-20 14:56:34 on dist-test-slave-7v06"
server_key: "e3399e96022b8f1fc316ab4dea1d5a01"
server_key_iv: "c8e7772cd98d0b1326ab354eb87ee21c"
server_key_version: "encryptionkey@0"
I20260620 14:56:35.850271 21409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:35.862506 21409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:35.865691 21409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:35.866297 21409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:35.872376 21409 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:40599
I20260620 14:56:35.872454 21476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:40599 every 8 connection(s)
I20260620 14:56:35.872964 21409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:35.874619 21477 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:56:35.875332 21477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Bootstrap starting.
I20260620 14:56:35.878522 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21409
I20260620 14:56:35.878928 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:40291
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:40599
--webserver_port=41329
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:56:35.886668 21477 log.cc:824] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:35.888825 21477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:56:35.889160 21477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Bootstrap complete.
I20260620 14:56:35.891597 21477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:35.891872 21477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1998925069408e88c29ca462c5745a, State: Initialized, Role: FOLLOWER
I20260620 14:56:35.892056 21477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:35.892132 21477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:35.892179 21477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:35.892236 21477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:56:35.895761 21477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:35.895963 21477 leader_election.cc:302] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f1998925069408e88c29ca462c5745a; no voters:
I20260620 14:56:35.897099 21477 leader_election.cc:288] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 14:56:35.897343 21481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 2 FOLLOWER]: Leader election won for term 2
I20260620 14:56:35.898155 21481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [term 2 LEADER]: Becoming Leader. State: Replica: 6f1998925069408e88c29ca462c5745a, State: Running, Role: LEADER
I20260620 14:56:35.899264 21477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:35.898885 21481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } }
I20260620 14:56:35.899983 21483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f1998925069408e88c29ca462c5745a. Latest consensus state: current_term: 2 leader_uuid: "6f1998925069408e88c29ca462c5745a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } } }
I20260620 14:56:35.900107 21483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:35.899997 21482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6f1998925069408e88c29ca462c5745a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1998925069408e88c29ca462c5745a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40599 } } }
I20260620 14:56:35.900563 21488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:35.900573 21482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:35.901535 21488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:35.901746 21488 catalog_manager.cc:1259] Loaded cluster ID: 1f3ac3d4b88b46b4bc3b1ed1e534892f
I20260620 14:56:35.901795 21488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:35.902871 21488 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:35.903126 21488 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6f1998925069408e88c29ca462c5745a: Loaded TSK: 0
I20260620 14:56:35.903470 21488 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 14:56:35.998081 21479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:35.998358 21479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:35.998386 21479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:36.000174 21479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:36.000260 21479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:36.000299 21479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:36.002393 21479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.129.keytab
--principal=oryx/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:40291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=41329
--tserver_master_addrs=127.12.116.190:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:36.002725 21479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:36.003043 21479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:36.009195 21503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:36.009195 21504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:36.009298 21506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:36.009495 21479 server_base.cc:1034] running on GCE node
I20260620 14:56:36.010082 21479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:36.010483 21479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:36.011775 21479 hybrid_clock.cc:648] HybridClock initialized: now 1781967396011760 us; error 42 us; skew 500 ppm
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967396, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:36.014847 21479 init.cc:377] Logged in from keytab as oryx/127.12.116.129@KRBTEST.COM (short username oryx)
I20260620 14:56:36.015395 21479 webserver.cc:460] Webserver started at http://127.12.116.129:41329/ using document root <none> and password file <none>
I20260620 14:56:36.015974 21479 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:36.016054 21479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:36.018059 21479 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:36.019233 21513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.019774 21479 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:36.019927 21479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "04843921709043a4bbd838305c75edc0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "988e51392c8b7554452959135573b582"
server_key_iv: "ba53a6223e97f4032dc513f0d8d98bd2"
server_key_version: "encryptionkey@0"
I20260620 14:56:36.020637 21479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:36.030990 21479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:36.034758 21479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:36.034981 21479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:36.035308 21479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:36.035696 21479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:36.035760 21479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.035806 21479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:36.035827 21479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.044462 21479 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40291
I20260620 14:56:36.044500 21626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40291 every 8 connection(s)
I20260620 14:56:36.045192 21479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:36.046284 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21479
I20260620 14:56:36.046615 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:40305
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:40599
--webserver_port=36067
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
W20260620 14:56:36.063750 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.048217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:41785 (local address 127.12.116.190:40599)
0620 14:56:36.048529 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.048546 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.048600 (+ 54us) server_negotiation.cc:407] Connection header received
0620 14:56:36.048767 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.048775 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.048855 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.049071 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.050652 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.052193 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.054883 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.055691 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.058006 (+ 2315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.063553 (+ 5547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:41785: BlockingRecv error: recv got EOF from 127.12.116.129:41785 (error 108)
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":127,"threads_started":1}
I20260620 14:56:36.063784 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.046091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:41785)
0620 14:56:36.046287 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.046333 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.046873 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.049256 (+ 2383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.049262 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.050147 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.050463 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.050472 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.052413 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.052415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.054456 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.054466 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.055849 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.055851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.056037 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.056802 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.056814 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.063357 (+ 6543us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
W20260620 14:56:36.064515 21627 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:40599 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.116.190:40599: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.070992 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.064939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:36771)
0620 14:56:36.065000 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.065011 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.065054 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.065228 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.065229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.065424 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.065494 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.065496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.066453 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.066454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.067343 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.067347 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.067944 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.067945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.068012 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.068614 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.068624 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.070909 (+ 2285us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260620 14:56:36.071558 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.065009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:36771 (local address 127.12.116.190:40599)
0620 14:56:36.065053 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.065055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.065068 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:56:36.065105 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.065106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.065120 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.065214 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.065592 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.066342 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.067458 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.067849 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.067938 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.071494 (+ 3556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:36771: BlockingRecv error: recv got EOF from 127.12.116.129:36771 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.078130 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.071772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:41605)
0620 14:56:36.071807 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.071820 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.071864 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.072021 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.072022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.072177 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.072227 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.072229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.073155 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.073157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.073941 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.073944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.074409 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.074410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.074464 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.075022 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.075028 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.078049 (+ 3021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":17}
W20260620 14:56:36.078272 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.071839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:41605 (local address 127.12.116.190:40599)
0620 14:56:36.071878 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.071880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.071890 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:36.071919 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.071920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.071931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.072007 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.072320 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.073055 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.074050 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.074319 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.074400 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.078206 (+ 3806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:41605: BlockingRecv error: recv got EOF from 127.12.116.129:41605 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260620 14:56:36.078559 21627 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 14:56:36.146088 21630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:36.146364 21630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:36.146394 21630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:36.147864 21630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:36.147941 21630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:36.147974 21630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:36.149791 21630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.130.keytab
--principal=oryx/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:40305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=36067
--tserver_master_addrs=127.12.116.190:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:36.150110 21630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:36.150398 21630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:36.156339 21636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:36.156479 21639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:36.156390 21637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:36.156652 21630 server_base.cc:1034] running on GCE node
I20260620 14:56:36.156937 21630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:36.157236 21630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:36.158437 21630 hybrid_clock.cc:648] HybridClock initialized: now 1781967396158412 us; error 44 us; skew 500 ppm
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967396, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:36.161554 21630 init.cc:377] Logged in from keytab as oryx/127.12.116.130@KRBTEST.COM (short username oryx)
I20260620 14:56:36.162077 21630 webserver.cc:460] Webserver started at http://127.12.116.130:36067/ using document root <none> and password file <none>
I20260620 14:56:36.162351 21630 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:36.162412 21630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:36.164213 21630 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:56:36.165079 21646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.165337 21630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:36.165436 21630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "b940de6af3854d0baef556e975d1a1f0"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "6d4461bae37461043504c548d6fe4afe"
server_key_iv: "6f52b6cc0549b0348791db0daa164253"
server_key_version: "encryptionkey@0"
I20260620 14:56:36.165795 21630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:36.178727 21630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:36.181366 21630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:36.181494 21630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:36.181699 21630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:36.182044 21630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:36.182080 21630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.182104 21630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:36.182116 21630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.189582 21630 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:40305
I20260620 14:56:36.189623 21759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:40305 every 8 connection(s)
I20260620 14:56:36.190037 21630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:36.193902 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21630
I20260620 14:56:36.194212 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:43029
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:40599
--webserver_port=33517
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.200702 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.190892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:53625)
0620 14:56:36.191048 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.191093 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.191586 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.191992 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.191996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.193298 (+ 1302us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.193544 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.193552 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.194572 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.194573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.195951 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.195956 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.196685 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.196686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.196828 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.197740 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.197751 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.200524 (+ 2773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
W20260620 14:56:36.200768 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.190937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:53625 (local address 127.12.116.190:40599)
0620 14:56:36.191006 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.191008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.191239 (+ 231us) server_negotiation.cc:407] Connection header received
0620 14:56:36.191775 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.191776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.191796 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.191869 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.193772 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.194443 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.196114 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.196558 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.196657 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.200677 (+ 4020us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:53625: BlockingRecv error: recv got EOF from 127.12.116.130:53625 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260620 14:56:36.201197 21760 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:40599 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.116.190:40599: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.206878 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.201492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:39463)
0620 14:56:36.201529 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.201541 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.201594 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.201725 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.201726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.201881 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.201937 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.201939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.202774 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.202775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.203765 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.203770 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.204194 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.204196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.204283 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.204916 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.204921 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.206782 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260620 14:56:36.206934 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.201537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:39463 (local address 127.12.116.190:40599)
0620 14:56:36.201611 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.201613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.201623 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:36.201661 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.201662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.201672 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.201724 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.202021 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.202660 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.203897 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.204092 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.204162 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.206872 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:39463: BlockingRecv error: recv got EOF from 127.12.116.130:39463 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.212018 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.207178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:56853)
0620 14:56:36.207235 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.207249 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.207302 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.207427 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.207428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.207584 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.207624 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.207626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.208302 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.208303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.209165 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.209168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.209524 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.209525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.209580 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.210062 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.210067 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.211958 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260620 14:56:36.212163 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.207268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:56853 (local address 127.12.116.190:40599)
0620 14:56:36.207303 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.207305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.207316 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:36.207351 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.207352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.207359 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.207406 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.207748 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.208223 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.209258 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.209449 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.209508 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.212086 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:56853: BlockingRecv error: recv got EOF from 127.12.116.130:56853 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 14:56:36.212224 21760 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 14:56:36.292981 21763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:36.293262 21763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:36.293292 21763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:36.294657 21763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:36.294719 21763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:36.294752 21763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:36.296844 21763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/krb5kdc/oryx_127.12.116.131.keytab
--principal=oryx/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:43029
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=33517
--tserver_master_addrs=127.12.116.190:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:36.297128 21763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:36.297339 21763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:36.304399 21768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:36.304486 21771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:36.304615 21769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:36.305347 21763 server_base.cc:1034] running on GCE node
I20260620 14:56:36.305874 21763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:36.306385 21763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:36.307760 21763 hybrid_clock.cc:648] HybridClock initialized: now 1781967396307698 us; error 85 us; skew 500 ppm
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967396, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:36.310885 21763 init.cc:377] Logged in from keytab as oryx/127.12.116.131@KRBTEST.COM (short username oryx)
I20260620 14:56:36.311443 21763 webserver.cc:460] Webserver started at http://127.12.116.131:33517/ using document root <none> and password file <none>
I20260620 14:56:36.311719 21763 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:36.311784 21763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:36.313598 21763 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:36.314438 21778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.314862 21763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:36.314961 21763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "52f8f7cb0195475199ec9e13a6720cfd"
format_stamp: "Formatted at 2026-06-20 14:56:35 on dist-test-slave-7v06"
server_key: "9d481054d50dcca39a8561bdd0203c40"
server_key_iv: "dc63cf724cc12e432d8ba524844150a6"
server_key_version: "encryptionkey@0"
I20260620 14:56:36.315419 21763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:36.331653 21763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:36.334698 21763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:36.334882 21763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:36.335155 21763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:36.335505 21763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:36.335563 21763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.335608 21763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:36.335636 21763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:36.342051 21763 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:43029
I20260620 14:56:36.342094 21891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:43029 every 8 connection(s)
I20260620 14:56:36.342496 21763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
W20260620 14:56:36.350600 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.343395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:54089 (local address 127.12.116.190:40599)
0620 14:56:36.343491 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.343493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.343626 (+ 133us) server_negotiation.cc:407] Connection header received
0620 14:56:36.344177 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.344178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.344192 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.344260 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.345294 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.345830 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.346924 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.347117 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.347189 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.350538 (+ 3349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:54089: BlockingRecv error: recv got EOF from 127.12.116.131:54089 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260620 14:56:36.350693 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.343324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:54089)
0620 14:56:36.343480 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.343518 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.344043 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.344317 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.344379 (+ 62us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.344981 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.345185 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.345190 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.345946 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.345947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.346810 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.346813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.347210 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.347211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.347325 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.347967 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.347976 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.350454 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
W20260620 14:56:36.350989 21892 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:40599 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.116.190:40599: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
I20260620 14:56:36.351138 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21763
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.357808 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.351318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:39387)
0620 14:56:36.351393 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.351407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.351463 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.351840 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.351841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.352039 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.352100 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.352102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.352995 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.352996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.353832 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.353835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.354302 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.354303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.354383 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.355092 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.355098 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.357655 (+ 2557us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260620 14:56:36.357826 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.351556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39387 (local address 127.12.116.190:40599)
0620 14:56:36.351684 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.351687 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.351699 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:36.351732 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.351733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.351743 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.351819 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.352178 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.352923 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.353905 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.354191 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.354275 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.357744 (+ 3469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:39387: BlockingRecv error: recv got EOF from 127.12.116.131:39387 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260620 14:56:36.360499 21896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.351655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55270 (local address 127.12.116.190:40599)
0620 14:56:36.351780 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.351784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.351813 (+ 29us) server_negotiation.cc:407] Connection header received
0620 14:56:36.351863 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.351864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.351875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.351960 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.352778 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.353580 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.354810 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.355117 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.355194 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.356584 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:36.356590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:36.356591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:36.356608 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:36.358970 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:36.359362 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:36.359366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:36.359366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:36.359473 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:36.359701 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:36.359702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:36.359702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:36.359952 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:36.360103 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:36.360213 (+ 110us) server_negotiation.cc:299] Negotiation successful
0620 14:56:36.360364 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":108,"thread_start_us":83,"threads_started":1}
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:36 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:36.363123 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:36.358120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:58799)
0620 14:56:36.358167 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:36.358177 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:36.358216 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:36.358368 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:36.358369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:36.358518 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:36.358561 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.358563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.359324 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.359325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.359847 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:36.359849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.360542 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.360543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:36.360611 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.361116 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:36.361122 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:36.363070 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 14:56:36.363283 21892 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 14:56:36.363303 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:36.358194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:58799 (local address 127.12.116.190:40599)
0620 14:56:36.358232 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:36.358234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:36.358242 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:36.358267 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:36.358268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:36.358284 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:36.358334 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:36.358668 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.359177 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.359933 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:36.360295 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:36.360529 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:36.363239 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:58799: BlockingRecv error: recv got EOF from 127.12.116.131:58799 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Jun 20 14:56:37 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:37 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:37.085845 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:37.079116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:36287)
0620 14:56:37.079262 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:37.079281 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:37.079345 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:37.079523 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:37.079524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:37.079734 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:37.079785 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:37.079786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.081097 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.081100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:37.081969 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:37.081973 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.082431 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.082432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:37.082495 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:37.083105 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:37.083110 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:37.085761 (+ 2651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
W20260620 14:56:37.086048 21898 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:37.079254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:36287 (local address 127.12.116.190:40599)
0620 14:56:37.079386 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:37.079388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:37.079396 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:37.079421 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:37.079422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:37.079431 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:37.079498 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:37.079917 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.080854 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.082083 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.082318 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.082420 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:37.085959 (+ 3539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:36287: BlockingRecv error: recv got EOF from 127.12.116.129:36287 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
Jun 20 14:56:37 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:37 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:37.218539 21899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:37.212789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:35379)
0620 14:56:37.212968 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:37.212982 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:37.213078 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:37.213247 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:37.213248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:37.213441 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:37.213492 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:37.213494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.214249 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.214250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:37.214802 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:37.214804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.215256 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.215257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:37.215317 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:37.215902 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:37.215907 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:37.218462 (+ 2555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":68,"threads_started":1}
W20260620 14:56:37.218725 21898 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:37.213000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:35379 (local address 127.12.116.190:40599)
0620 14:56:37.213073 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:37.213076 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:37.213088 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:37.213144 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:37.213145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:37.213158 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:37.213240 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:37.213589 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.214109 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.214902 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.215173 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.215259 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:37.218647 (+ 3388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:35379: BlockingRecv error: recv got EOF from 127.12.116.130:35379 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Jun 20 14:56:37 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:37 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:37.369119 21900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:37.363784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:60667)
0620 14:56:37.364012 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:37.364024 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:37.364122 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:37.364356 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:37.364357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:37.364544 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:37.364611 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:37.364612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.365585 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.365587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:37.366131 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:37.366134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.366530 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.366531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:37.366588 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:37.367071 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:37.367076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:37.368984 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":133,"threads_started":1}
W20260620 14:56:37.369228 21898 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:37.363889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:60667 (local address 127.12.116.190:40599)
0620 14:56:37.363979 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:37.363982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:37.364102 (+ 120us) server_negotiation.cc:407] Connection header received
0620 14:56:37.364240 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:37.364243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:37.364262 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:37.364326 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:37.364730 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.365494 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.366232 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:37.366442 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:37.366528 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:37.369134 (+ 2606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:60667: BlockingRecv error: recv got EOF from 127.12.116.131:60667 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Jun 20 14:56:38 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:38 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:38.093730 21901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:38.086601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:60529)
0620 14:56:38.086794 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:38.086811 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:38.086898 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:38.087171 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:38.087172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:38.087360 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:38.087412 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:38.087414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.088230 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.088231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:38.088908 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:38.088911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.089418 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.089420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:38.089472 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:38.090097 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:38.090120 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:38.093643 (+ 3523us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":80,"threads_started":1}
W20260620 14:56:38.093899 21902 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:38.086773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:60529 (local address 127.12.116.190:40599)
0620 14:56:38.086968 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:38.086970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:38.086984 (+ 14us) server_negotiation.cc:407] Connection header received
0620 14:56:38.087021 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:38.087021 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:38.087032 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:38.087099 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:38.087538 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.088096 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.089053 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.089268 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.089331 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:38.093817 (+ 4486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:60529: BlockingRecv error: recv got EOF from 127.12.116.129:60529 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":92,"threads_started":1}
Jun 20 14:56:38 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:38 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:38.225291 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:38.219223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:58989)
0620 14:56:38.219411 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:38.219422 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:38.219506 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:38.219754 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:38.219755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:38.219944 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:38.220023 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:38.220025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.220975 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.220976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:38.221562 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:38.221565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.221950 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.221951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:38.222003 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:38.222614 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:38.222619 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:38.225226 (+ 2607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":115,"threads_started":1}
W20260620 14:56:38.225502 21902 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:38.219303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:58989 (local address 127.12.116.190:40599)
0620 14:56:38.219398 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:38.219401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:38.219487 (+ 86us) server_negotiation.cc:407] Connection header received
0620 14:56:38.219560 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:38.219561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:38.219573 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:38.219658 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:38.220244 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.220875 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.221652 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.221854 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.221918 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:38.225434 (+ 3516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:58989: BlockingRecv error: recv got EOF from 127.12.116.130:58989 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Jun 20 14:56:38 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:38 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:38.377839 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:38.369905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:39475)
0620 14:56:38.370122 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:38.370136 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:38.370214 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:38.370429 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:38.370430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:38.370657 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:38.370707 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:38.370709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.371629 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.371630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:38.372683 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:38.372687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.373276 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.373277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:38.373621 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:38.374788 (+ 1167us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:38.374796 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:38.377770 (+ 2974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":73,"threads_started":1}
W20260620 14:56:38.378103 21902 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:38.370067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39475 (local address 127.12.116.190:40599)
0620 14:56:38.370137 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:38.370140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:38.370225 (+ 85us) server_negotiation.cc:407] Connection header received
0620 14:56:38.370266 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:38.370267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:38.370289 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:38.370365 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:38.370833 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.371476 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.372959 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:38.373153 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:38.373238 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:38.378021 (+ 4783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:39475: BlockingRecv error: recv got EOF from 127.12.116.131:39475 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Jun 20 14:56:39 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:39 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:39.103582 21905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:39.095069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:37625)
0620 14:56:39.095303 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:39.095316 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:39.095385 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:39.095554 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:39.095555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:39.095806 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:39.096006 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:39.096010 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.097193 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.097195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:39.098747 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:39.098753 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.099740 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.099743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:39.099843 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:39.100723 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:39.100730 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:39.103491 (+ 2761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":92,"threads_started":1}
W20260620 14:56:39.104183 21906 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:39.095225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:37625 (local address 127.12.116.190:40599)
0620 14:56:39.095400 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:39.095402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:39.095411 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:39.095439 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:39.095439 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:39.095453 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:39.095521 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:39.096194 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.096909 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.099045 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.099296 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.099379 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:39.104037 (+ 4658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:37625: BlockingRecv error: recv got EOF from 127.12.116.129:37625 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":64,"threads_started":1}
Jun 20 14:56:39 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:39 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:39.232864 21907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:39.226035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:46911)
0620 14:56:39.226311 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:39.226328 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:39.226463 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:39.226723 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:39.226726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:39.226971 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:39.227021 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:39.227024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.228104 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.228105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:39.228710 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:39.228713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.229162 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.229163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:39.229218 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:39.229921 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:39.229926 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:39.232764 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":96,"threads_started":1}
W20260620 14:56:39.232930 21906 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:39.226312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:46911 (local address 127.12.116.190:40599)
0620 14:56:39.226375 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:39.226377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:39.226435 (+ 58us) server_negotiation.cc:407] Connection header received
0620 14:56:39.226546 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:39.226548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:39.226560 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:39.226617 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:39.227156 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.227879 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.228859 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.229054 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.229117 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:39.232867 (+ 3750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:46911: BlockingRecv error: recv got EOF from 127.12.116.130:46911 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Jun 20 14:56:39 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:39 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:39.385249 21908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:39.378704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:38539)
0620 14:56:39.378945 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:39.378966 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:39.379054 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:39.379330 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:39.379332 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:39.379524 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:39.379584 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:39.379586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.380731 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.380733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:39.381613 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:39.381620 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.382254 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.382255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:39.382323 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:39.382911 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:39.382917 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:39.385138 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":109,"threads_started":1}
W20260620 14:56:39.385305 21906 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:39.378877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:38539 (local address 127.12.116.190:40599)
0620 14:56:39.378995 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:39.378997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:39.379046 (+ 49us) server_negotiation.cc:407] Connection header received
0620 14:56:39.379116 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:39.379117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:39.379133 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:39.379197 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:39.379814 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.380578 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.381928 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:39.382143 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:39.382280 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:39.385240 (+ 2960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:38539: BlockingRecv error: recv got EOF from 127.12.116.131:38539 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Jun 20 14:56:40 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:40 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:40.110473 21909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:40.104274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:38907)
0620 14:56:40.104588 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:40.104600 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:40.104707 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:40.104905 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:40.104906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:40.105078 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:40.105134 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:40.105136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.105929 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.105931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:40.106894 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:40.106897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.107300 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.107301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:40.107356 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:40.107880 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:40.107885 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:40.110373 (+ 2488us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":158,"threads_started":1}
W20260620 14:56:40.110561 21910 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:40.104428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:38907 (local address 127.12.116.190:40599)
0620 14:56:40.104574 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:40.104577 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:40.104738 (+ 161us) server_negotiation.cc:407] Connection header received
0620 14:56:40.104796 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:40.104797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:40.104808 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:40.104873 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:40.105254 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.105800 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.107007 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.107215 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.107301 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:40.110486 (+ 3185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:38907: BlockingRecv error: recv got EOF from 127.12.116.129:38907 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":54,"threads_started":1}
Jun 20 14:56:40 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:40 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:40.240135 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:40.233533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:46381)
0620 14:56:40.233767 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:40.233832 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:40.233917 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:40.234129 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:40.234130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:40.234309 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:40.234362 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:40.234364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.235110 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.235111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:40.235847 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:40.235854 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.236802 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.236804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:40.236877 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:40.237727 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:40.237733 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:40.240060 (+ 2327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":108,"threads_started":1}
W20260620 14:56:40.240559 21910 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:40.233731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:46381 (local address 127.12.116.190:40599)
0620 14:56:40.233840 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:40.233843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:40.233896 (+ 53us) server_negotiation.cc:407] Connection header received
0620 14:56:40.233986 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:40.233987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:40.233999 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:40.234067 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:40.234465 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.235002 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.236023 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.236463 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.236559 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:40.240339 (+ 3780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:46381: BlockingRecv error: recv got EOF from 127.12.116.130:46381 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Jun 20 14:56:40 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:40 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:40.397828 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:40.386141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:50977)
0620 14:56:40.386318 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:40.386365 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:40.386422 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:40.386651 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:40.386651 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:40.386862 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:40.386915 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:40.386917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.388405 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.388407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:40.388993 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:40.388995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.389501 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.389502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:40.389563 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:40.394625 (+ 5062us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:40.394634 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:40.397751 (+ 3117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
W20260620 14:56:40.398038 21910 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:40.386269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:50977 (local address 127.12.116.190:40599)
0620 14:56:40.386439 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:40.386441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:40.386456 (+ 15us) server_negotiation.cc:407] Connection header received
0620 14:56:40.386491 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:40.386492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:40.386515 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:40.386589 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:40.387062 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.388007 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.389155 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:40.389365 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:40.389437 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:40.397930 (+ 8493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:50977: BlockingRecv error: recv got EOF from 127.12.116.131:50977 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Jun 20 14:56:41 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:41 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:41.117856 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:41.111202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:43727)
0620 14:56:41.111403 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:41.111415 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:41.111484 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:41.111763 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:41.111765 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:41.112026 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:41.112107 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:41.112109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.113148 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.113151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:41.113785 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:41.113787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.114393 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.114394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:41.114448 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:41.115162 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:41.115168 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:41.117781 (+ 2613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":119,"threads_started":1}
W20260620 14:56:41.118122 21914 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:41.111357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:43727 (local address 127.12.116.190:40599)
0620 14:56:41.111470 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:41.111475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:41.111493 (+ 18us) server_negotiation.cc:407] Connection header received
0620 14:56:41.111549 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:41.111550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:41.111562 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:41.111626 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:41.112296 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.113019 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.113951 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.114197 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.114299 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:41.117997 (+ 3698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:43727: BlockingRecv error: recv got EOF from 127.12.116.129:43727 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
Jun 20 14:56:41 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:41 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:41.245818 21915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:41.240832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:42003)
0620 14:56:41.241044 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:41.241059 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:41.241130 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:41.241322 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:41.241322 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:41.241494 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:41.241545 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:41.241547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.242269 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.242270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:41.242840 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:41.242842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.243239 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.243240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:41.243284 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:41.243922 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:41.243928 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:41.245739 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":85,"threads_started":1}
W20260620 14:56:41.245937 21914 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:41.241092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:42003 (local address 127.12.116.190:40599)
0620 14:56:41.241164 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:41.241166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:41.241176 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:41.241211 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:41.241212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:41.241223 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:41.241275 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:41.241629 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.242151 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.242945 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.243137 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.243234 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:41.245868 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:42003: BlockingRecv error: recv got EOF from 127.12.116.130:42003 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Jun 20 14:56:41 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:41 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:41.405580 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:41.398778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:38945)
0620 14:56:41.398952 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:41.398964 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:41.399026 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:41.399549 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:41.399551 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:41.399932 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:41.399998 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:41.400001 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.401296 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.401298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:41.402047 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:41.402051 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.402517 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.402518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:41.402583 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:41.403257 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:41.403263 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:41.405467 (+ 2204us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":104,"threads_started":1}
W20260620 14:56:41.405649 21914 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:41.399041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:38945 (local address 127.12.116.190:40599)
0620 14:56:41.399234 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:41.399237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:41.399245 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:56:41.399272 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:41.399272 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:41.399286 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:41.399402 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:41.400129 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.401166 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.402150 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:41.402384 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:41.402516 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:41.405579 (+ 3063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:38945: BlockingRecv error: recv got EOF from 127.12.116.131:38945 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
Jun 20 14:56:42 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:42 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:42.127614 21917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:42.118918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:45857)
0620 14:56:42.119265 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:42.119293 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:42.119447 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:42.119830 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:42.119832 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:42.120304 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:42.120402 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:42.120406 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.121257 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.121259 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:42.122116 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:42.122120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.122692 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.122694 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:42.122777 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:42.124177 (+ 1400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:42.124184 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:42.127527 (+ 3343us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":212,"threads_started":1}
W20260620 14:56:42.127884 21918 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:42.119056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:45857 (local address 127.12.116.190:40599)
0620 14:56:42.119453 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:42.119456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:42.119525 (+ 69us) server_negotiation.cc:407] Connection header received
0620 14:56:42.119644 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:42.119647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:42.119675 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:42.119774 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:42.120504 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.121139 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.122341 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.122582 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.122689 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:42.127795 (+ 5106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:45857: BlockingRecv error: recv got EOF from 127.12.116.129:45857 (error 108)
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":164,"threads_started":1}
Jun 20 14:56:42 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:42 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:42.252152 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:42.246528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:51933)
0620 14:56:42.246741 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:42.246756 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:42.247045 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:42.247219 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:42.247220 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:42.247427 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:42.247477 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:42.247479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.248427 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.248428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:42.249029 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:42.249032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.249414 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.249415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:42.249472 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:42.249998 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:42.250003 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:42.252044 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":102,"threads_started":1}
W20260620 14:56:42.252207 21918 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:42.246644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:51933 (local address 127.12.116.190:40599)
0620 14:56:42.246746 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:42.246749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:42.247019 (+ 270us) server_negotiation.cc:407] Connection header received
0620 14:56:42.247128 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:42.247129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:42.247142 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:42.247214 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:42.247664 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.248303 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.249127 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.249329 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.249413 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:42.252143 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:51933: BlockingRecv error: recv got EOF from 127.12.116.130:51933 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Jun 20 14:56:42 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:42 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:42.412053 21920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:42.406332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:48247)
0620 14:56:42.406508 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:42.406519 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:42.406584 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:42.406834 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:42.406836 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:42.407031 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:42.407082 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:42.407083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.407904 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.407905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:42.408741 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:42.408743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.409183 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.409184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:42.409241 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:42.409822 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:42.409834 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:42.411988 (+ 2154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":106,"threads_started":1}
W20260620 14:56:42.412499 21918 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:42.406403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:48247 (local address 127.12.116.190:40599)
0620 14:56:42.406451 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:42.406454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:42.406585 (+ 131us) server_negotiation.cc:407] Connection header received
0620 14:56:42.406638 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:42.406639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:42.406657 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:42.406722 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:42.407223 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.407766 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.408867 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:42.409072 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:42.409138 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:42.412383 (+ 3245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:48247: BlockingRecv error: recv got EOF from 127.12.116.131:48247 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 20 14:56:43 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:43 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:43.139079 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:43.128790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:37947)
0620 14:56:43.128948 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:43.128962 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:43.129030 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:43.129351 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:43.129352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:43.129531 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:43.129586 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:43.129588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.130330 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.130331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:43.130898 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:43.130900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.131387 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.131388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:43.131486 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:43.136987 (+ 5501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:43.136997 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:43.139011 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
W20260620 14:56:43.139379 21922 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:43.128964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:37947 (local address 127.12.116.190:40599)
0620 14:56:43.129177 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:43.129178 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:43.129189 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:43.129219 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:43.129220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:43.129230 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:43.129308 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:43.129681 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.130196 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.131005 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.131242 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.131363 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:43.139304 (+ 7941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:37947: BlockingRecv error: recv got EOF from 127.12.116.129:37947 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":155,"threads_started":1}
Jun 20 14:56:43 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:43 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:43.258390 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:43.252930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:52807)
0620 14:56:43.253098 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:43.253109 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:43.253175 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:43.253366 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:43.253367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:43.253537 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:43.253586 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:43.253588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.254404 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.254405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:43.255038 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:43.255041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.255476 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.255477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:43.255528 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:43.256130 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:43.256135 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:43.258316 (+ 2181us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260620 14:56:43.258598 21922 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:43.253057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:52807 (local address 127.12.116.190:40599)
0620 14:56:43.253115 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:43.253117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:43.253158 (+ 41us) server_negotiation.cc:407] Connection header received
0620 14:56:43.253225 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:43.253226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:43.253237 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:43.253336 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:43.253722 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.254299 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.255149 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.255364 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.255434 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:43.258510 (+ 3076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:52807: BlockingRecv error: recv got EOF from 127.12.116.130:52807 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 20 14:56:43 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:43 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:43.419945 21924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:43.413017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:39909)
0620 14:56:43.413169 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:43.413189 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:43.413243 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:43.413394 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:43.413395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:43.413560 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:43.413611 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:43.413612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.414441 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.414442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:43.415155 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:43.415158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.415557 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.415558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:43.415620 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:43.416315 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:43.416367 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:43.419867 (+ 3500us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
W20260620 14:56:43.420173 21922 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:43.413145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39909 (local address 127.12.116.190:40599)
0620 14:56:43.413194 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:43.413224 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:43.413235 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:43.413315 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:43.413316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:43.413329 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:43.413374 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:43.413683 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.414322 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.415238 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:43.415423 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:43.415484 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:43.420108 (+ 4624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:39909: BlockingRecv error: recv got EOF from 127.12.116.131:39909 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Jun 20 14:56:44 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:44 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:44.147413 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:44.139782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:58541)
0620 14:56:44.139962 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:44.139982 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:44.140039 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:44.140504 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:44.140505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:44.140714 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:44.140822 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:44.140824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.142235 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.142237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:44.142854 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:44.142856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.143503 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.143505 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:44.143589 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:44.144495 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:44.144501 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:44.147323 (+ 2822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":116,"threads_started":1}
W20260620 14:56:44.147794 21926 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:44.140055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:58541 (local address 127.12.116.190:40599)
0620 14:56:44.140240 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:44.140243 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:44.140261 (+ 18us) server_negotiation.cc:407] Connection header received
0620 14:56:44.140297 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:44.140298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:44.140311 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:44.140437 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:44.141068 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.142065 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.143075 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.143331 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.143429 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:44.147620 (+ 4191us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:58541: BlockingRecv error: recv got EOF from 127.12.116.129:58541 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":103,"threads_started":1}
Jun 20 14:56:44 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:44 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:44.264540 21927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:44.259089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:43279)
0620 14:56:44.259287 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:44.259297 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:44.259363 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:44.259539 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:44.259540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:44.259739 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:44.259789 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:44.259791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.260806 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.260807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:44.261339 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:44.261341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.261746 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.261746 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:44.261795 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:44.262311 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:44.262316 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:44.264473 (+ 2157us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":97,"threads_started":1}
W20260620 14:56:44.264719 21926 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:44.259243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:43279 (local address 127.12.116.190:40599)
0620 14:56:44.259300 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:44.259302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:44.259370 (+ 68us) server_negotiation.cc:407] Connection header received
0620 14:56:44.259411 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:44.259411 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:44.259423 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:44.259491 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:44.259896 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.260657 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.261439 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.261647 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.261709 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:44.264609 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:43279: BlockingRecv error: recv got EOF from 127.12.116.130:43279 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Jun 20 14:56:44 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:44 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:44.427479 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:44.420768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:44287)
0620 14:56:44.421004 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:44.421017 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:44.421124 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:44.421360 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:44.421361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:44.421584 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:44.421656 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:44.421657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.422612 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.422615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:44.423303 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:44.423307 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.423946 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.423948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:44.424007 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:44.424752 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:44.424758 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:44.427357 (+ 2599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":149,"threads_started":1}
W20260620 14:56:44.427523 21926 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:44.420945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:44287 (local address 127.12.116.190:40599)
0620 14:56:44.421107 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:44.421109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:44.421125 (+ 16us) server_negotiation.cc:407] Connection header received
0620 14:56:44.421189 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:44.421191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:44.421207 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:44.421281 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:44.421774 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.422426 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.423572 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:44.423817 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:44.423912 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:44.427452 (+ 3540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:44287: BlockingRecv error: recv got EOF from 127.12.116.131:44287 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Jun 20 14:56:45 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:45 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:45.154702 21929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:45.148402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:33867)
0620 14:56:45.148611 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:45.148622 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:45.148775 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:45.149023 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:45.149024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:45.149287 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:45.149346 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:45.149349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.150070 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.150071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:45.150768 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:45.150770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.151147 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.151148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:45.151201 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:45.151737 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:45.151743 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:45.154599 (+ 2856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":69,"threads_started":1}
W20260620 14:56:45.155048 21930 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:45.148468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:33867 (local address 127.12.116.190:40599)
0620 14:56:45.148602 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:45.148604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:45.148770 (+ 166us) server_negotiation.cc:407] Connection header received
0620 14:56:45.148878 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:45.148879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:45.148891 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:45.148993 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:45.149422 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.149962 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.150858 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.151069 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.151149 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:45.154949 (+ 3800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:33867: BlockingRecv error: recv got EOF from 127.12.116.129:33867 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
Jun 20 14:56:45 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:45 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:45.270655 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:45.265175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:45267)
0620 14:56:45.265365 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:45.265381 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:45.265469 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:45.265615 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:45.265616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:45.265816 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:45.265867 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:45.265869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.266588 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.266590 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:45.267129 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:45.267131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.267550 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.267551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:45.267607 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:45.268297 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:45.268302 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:45.270578 (+ 2276us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
W20260620 14:56:45.270834 21930 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:45.265304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:45267 (local address 127.12.116.190:40599)
0620 14:56:45.265399 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:45.265401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:45.265446 (+ 45us) server_negotiation.cc:407] Connection header received
0620 14:56:45.265539 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:45.265540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:45.265551 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:45.265598 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:45.265956 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.266488 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.267234 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.267462 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.267550 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:45.270749 (+ 3199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:45267: BlockingRecv error: recv got EOF from 127.12.116.130:45267 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Jun 20 14:56:45 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:45 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:45.437734 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:45.428217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:37641)
0620 14:56:45.428393 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:45.428407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:45.428486 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:45.428711 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:45.428712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:45.429113 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:45.429162 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:45.429165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.429902 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.429903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:45.430417 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:45.430419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.430791 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.430793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:45.430856 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:45.435682 (+ 4826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:45.435689 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:45.437658 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
W20260620 14:56:45.438179 21930 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:45.428393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:37641 (local address 127.12.116.190:40599)
0620 14:56:45.428467 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:45.428470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:45.428483 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:56:45.428550 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:45.428551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:45.428565 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:45.428697 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:45.429290 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.429806 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.430507 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:45.430706 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:45.430781 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:45.438011 (+ 7230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:37641: BlockingRecv error: recv got EOF from 127.12.116.131:37641 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 20 14:56:46 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:46 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:46.162670 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:46.155493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:40599)
0620 14:56:46.155678 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:46.155693 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:46.155799 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:46.155998 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:46.156000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:46.156212 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:46.156272 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:46.156275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.157451 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.157453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:46.158066 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:46.158069 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.158609 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.158611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:46.158688 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:46.159402 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:46.159408 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:46.162532 (+ 3124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":113,"threads_started":1}
W20260620 14:56:46.162915 21934 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:46.155619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:40599 (local address 127.12.116.190:40599)
0620 14:56:46.155789 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:46.155791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:46.155810 (+ 19us) server_negotiation.cc:407] Connection header received
0620 14:56:46.155863 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:46.155863 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:46.155876 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:46.155945 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:46.156485 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.157275 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.158219 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.158469 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.158552 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:46.162680 (+ 4128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:40599: BlockingRecv error: recv got EOF from 127.12.116.129:40599 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
Jun 20 14:56:46 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:46 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:46.277069 21935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:46.271248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:49565)
0620 14:56:46.271444 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:46.271459 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:46.271564 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:46.271744 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:46.271744 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:46.271929 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:46.272182 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:46.272185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.272941 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.272943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:46.273725 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:46.273729 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.274131 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.274132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:46.274184 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:46.274791 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:46.274797 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:46.276978 (+ 2181us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":89,"threads_started":1}
W20260620 14:56:46.277148 21934 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:46.271360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:49565 (local address 127.12.116.190:40599)
0620 14:56:46.271463 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:46.271465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:46.271542 (+ 77us) server_negotiation.cc:407] Connection header received
0620 14:56:46.271663 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:46.271664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:46.271677 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:46.271738 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:46.272276 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.272849 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.273822 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.274020 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.274131 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:46.277084 (+ 2953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:49565: BlockingRecv error: recv got EOF from 127.12.116.130:49565 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Jun 20 14:56:46 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:46 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:46.444763 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:46.438702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:33177)
0620 14:56:46.438870 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:46.438889 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:46.438972 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:46.439125 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:46.439126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:46.439307 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:46.439360 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:46.439361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.440066 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.440067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:46.440625 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:46.440627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.441138 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.441139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:46.441231 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:46.442049 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:46.442057 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:46.444633 (+ 2576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
W20260620 14:56:46.444802 21934 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:46.438887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:33177 (local address 127.12.116.190:40599)
0620 14:56:46.438968 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:46.438971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:46.438982 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:46.439030 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:46.439032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:46.439052 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:46.439118 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:46.439446 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.439974 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.440719 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:46.440921 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:46.441137 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:46.444737 (+ 3600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:33177: BlockingRecv error: recv got EOF from 127.12.116.131:33177 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Jun 20 14:56:47 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:47 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:47.169152 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:47.163437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:43323)
0620 14:56:47.163603 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:47.163614 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:47.163671 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:47.163895 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:47.163897 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:47.164172 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:47.164434 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:47.164439 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.165249 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.165250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:47.165861 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:47.165863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.166320 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.166321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:47.166380 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:47.166984 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:47.166989 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:47.169066 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
W20260620 14:56:47.169394 21938 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:47.163511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:43323 (local address 127.12.116.190:40599)
0620 14:56:47.163685 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:47.163687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:47.163697 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:47.163722 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:47.163723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:47.163734 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:47.163804 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:47.164563 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.165155 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.165979 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.166187 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.166254 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:47.169293 (+ 3039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:43323: BlockingRecv error: recv got EOF from 127.12.116.129:43323 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
Jun 20 14:56:47 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:47 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:47.283726 21939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:47.277742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:36377)
0620 14:56:47.277894 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:47.277904 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:47.277958 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:47.278191 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:47.278193 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:47.278437 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:47.278510 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:47.278513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.279409 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.279411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:47.280042 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:47.280045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.280619 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.280620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:47.280702 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:47.281311 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:47.281316 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:47.283647 (+ 2331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
W20260620 14:56:47.283972 21938 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:47.277858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:36377 (local address 127.12.116.190:40599)
0620 14:56:47.277930 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:47.277932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:47.277945 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:56:47.278020 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:47.278020 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:47.278031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:47.278098 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:47.278740 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.279275 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.280190 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.280484 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.280575 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:47.283907 (+ 3332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:36377: BlockingRecv error: recv got EOF from 127.12.116.130:36377 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Jun 20 14:56:47 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:47 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:47.451332 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:47.445496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:48815)
0620 14:56:47.445673 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:47.445689 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:47.445761 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:47.445901 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:47.445902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:47.446096 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:47.446145 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:47.446147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.447009 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.447010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:47.447564 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:47.447567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.447988 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.447989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:47.448049 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:47.448690 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:47.448698 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:47.451195 (+ 2497us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":66,"threads_started":1}
W20260620 14:56:47.451346 21938 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:47.445674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:48815 (local address 127.12.116.190:40599)
0620 14:56:47.445765 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:47.445767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:47.445779 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:47.445806 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:47.445807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:47.445820 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:47.445873 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:47.446271 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.446916 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.447679 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:47.447889 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:47.447986 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:47.451283 (+ 3297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:48815: BlockingRecv error: recv got EOF from 127.12.116.131:48815 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Jun 20 14:56:48 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:48 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:48.174702 21941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:48.169861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:47221)
0620 14:56:48.170034 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:48.170046 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:48.170112 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:48.170263 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:48.170264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:48.170443 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:48.170492 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:48.170494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.171244 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.171245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:48.171795 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:48.171797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.172244 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.172245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:48.172297 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:48.172862 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:48.172867 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:48.174639 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
W20260620 14:56:48.174963 21942 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:48.169983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:47221 (local address 127.12.116.190:40599)
0620 14:56:48.170117 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:48.170119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:48.170130 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:56:48.170178 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:48.170178 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:48.170190 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:48.170242 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:48.170589 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.171122 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.171907 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.172158 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.172235 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:48.174889 (+ 2654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:47221: BlockingRecv error: recv got EOF from 127.12.116.129:47221 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
Jun 20 14:56:48 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:48 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:48.290064 21943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:48.284549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:41503)
0620 14:56:48.284715 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:48.284727 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:48.284831 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:48.284989 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:48.284990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:48.285174 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:48.285227 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:48.285229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.285942 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.285943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:48.286571 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:48.286574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.287105 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.287107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:48.287172 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:48.287763 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:48.287777 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:48.289972 (+ 2195us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
W20260620 14:56:48.290252 21942 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:48.284649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:41503 (local address 127.12.116.190:40599)
0620 14:56:48.284725 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:48.284727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:48.284830 (+ 103us) server_negotiation.cc:407] Connection header received
0620 14:56:48.284886 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:48.284887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:48.284898 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:48.284967 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:48.285298 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.285827 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.286709 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.286953 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.287028 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:48.290142 (+ 3114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:41503: BlockingRecv error: recv got EOF from 127.12.116.130:41503 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Jun 20 14:56:48 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:48 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:48.460515 21944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:48.452053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:42775)
0620 14:56:48.452246 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:48.452258 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:48.452353 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:48.452775 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:48.452776 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:48.453310 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:48.453363 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:48.453365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.454423 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.454424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:48.455094 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:48.455096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.456008 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.456010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:48.456104 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:48.457002 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:48.457008 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:48.460424 (+ 3416us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":128,"threads_started":1}
W20260620 14:56:48.460880 21942 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:48.452202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:42775 (local address 127.12.116.190:40599)
0620 14:56:48.452251 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:48.452254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:48.452444 (+ 190us) server_negotiation.cc:407] Connection header received
0620 14:56:48.452485 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:48.452486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:48.452506 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:48.452580 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:48.453502 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.454312 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.455383 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:48.455838 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:48.455926 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:48.460545 (+ 4619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:42775: BlockingRecv error: recv got EOF from 127.12.116.131:42775 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Jun 20 14:56:49 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:49 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:49.181077 21945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:49.175506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:36629)
0620 14:56:49.175767 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:49.175782 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:49.175881 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:49.176105 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:49.176107 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:49.176300 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:49.176452 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:49.176455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.177291 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.177292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:49.177869 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:49.177871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.178323 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.178324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:49.178371 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:49.178952 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:49.178957 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:49.181013 (+ 2056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":108,"threads_started":1}
W20260620 14:56:49.181306 21946 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:49.175583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:36629 (local address 127.12.116.190:40599)
0620 14:56:49.175731 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:49.175733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:49.175907 (+ 174us) server_negotiation.cc:407] Connection header received
0620 14:56:49.175951 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:49.175951 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:49.175967 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:49.176065 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:49.176590 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.177176 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.178013 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.178221 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.178305 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:49.181152 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:36629: BlockingRecv error: recv got EOF from 127.12.116.129:36629 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
Jun 20 14:56:49 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:49 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
W20260620 14:56:49.296687 21946 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:49.290994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:42381 (local address 127.12.116.190:40599)
0620 14:56:49.291073 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:49.291075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:49.291168 (+ 93us) server_negotiation.cc:407] Connection header received
0620 14:56:49.291276 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:49.291277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:49.291296 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:49.291368 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:49.291703 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.292209 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.292961 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.293158 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.293252 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:49.296622 (+ 3370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:42381: BlockingRecv error: recv got EOF from 127.12.116.130:42381 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 14:56:49.297019 21947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:49.290870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:42381)
0620 14:56:49.291086 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:49.291096 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:49.291181 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:49.291389 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:49.291390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:49.291577 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:49.291622 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:49.291624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.292300 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.292301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:49.292860 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:49.292861 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.293251 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.293252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:49.293313 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:49.293859 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:49.293864 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:49.296436 (+ 2572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":68,"threads_started":1}
Jun 20 14:56:49 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:49 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:49.466388 21948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:49.461264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:38239)
0620 14:56:49.461411 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:49.461455 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:49.461524 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:49.461701 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:49.461701 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:49.461892 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:49.461940 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:49.461942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.462637 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.462638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:49.463155 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:49.463157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.463520 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.463521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:49.463573 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:49.464410 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:49.464415 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:49.466322 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
W20260620 14:56:49.466740 21946 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:49.461396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:38239 (local address 127.12.116.190:40599)
0620 14:56:49.461495 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:49.461497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:49.461528 (+ 31us) server_negotiation.cc:407] Connection header received
0620 14:56:49.461614 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:49.461615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:49.461630 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:49.461689 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:49.462031 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.462538 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.463262 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:49.463446 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:49.463522 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:49.466655 (+ 3133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:38239: BlockingRecv error: recv got EOF from 127.12.116.131:38239 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Jun 20 14:56:50 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:50 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:50.187479 21949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:50.182036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:44861)
0620 14:56:50.182186 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:50.182205 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:50.182278 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:50.182457 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:50.182458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:50.182632 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:50.182679 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:50.182681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.183513 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.183514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:50.184271 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:50.184274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.184819 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.184820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:50.184869 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:50.185392 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:50.185397 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:50.187367 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
W20260620 14:56:50.187546 21950 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:50.182152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:44861 (local address 127.12.116.190:40599)
0620 14:56:50.182306 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:50.182308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:50.182318 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:56:50.182347 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:50.182348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:50.182358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:50.182434 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:50.182749 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.183392 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.184428 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.184698 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.184758 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:50.187471 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:44861: BlockingRecv error: recv got EOF from 127.12.116.129:44861 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
Jun 20 14:56:50 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:50 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:50.304739 21951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:50.297720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:57755)
0620 14:56:50.297969 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:50.297982 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:50.298081 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:50.298385 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:50.298386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:50.298983 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:50.299037 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:50.299040 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.299794 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.299795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:50.300610 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:50.300613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.301680 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.301681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:50.301742 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:50.302308 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:50.302316 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:50.304662 (+ 2346us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":104,"threads_started":1}
W20260620 14:56:50.304939 21950 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:50.297837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:57755 (local address 127.12.116.190:40599)
0620 14:56:50.297948 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:50.297950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:50.298060 (+ 110us) server_negotiation.cc:407] Connection header received
0620 14:56:50.298182 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:50.298183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:50.298202 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:50.298379 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:50.299149 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.299689 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.301043 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.301551 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.301716 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:50.304872 (+ 3156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:57755: BlockingRecv error: recv got EOF from 127.12.116.130:57755 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Jun 20 14:56:50 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:50 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.131@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:50.477977 21952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:50.467293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.131:41843)
0620 14:56:50.467541 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:50.467553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:50.467668 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:50.467853 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:50.467854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:50.468057 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:50.468145 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:50.468148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.469024 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.469025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:50.469696 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:50.469699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.470136 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.470137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:50.470199 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:50.475672 (+ 5473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:50.475680 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:50.477846 (+ 2166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":137,"threads_started":1}
W20260620 14:56:50.478029 21950 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:50.467390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:41843 (local address 127.12.116.190:40599)
0620 14:56:50.467530 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:50.467533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:50.467646 (+ 113us) server_negotiation.cc:407] Connection header received
0620 14:56:50.467755 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:50.467756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:50.467772 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:50.467837 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:50.468243 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.468909 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.469801 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:50.470030 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:50.470126 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:50.477959 (+ 7833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.131:41843: BlockingRecv error: recv got EOF from 127.12.116.131:41843 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Jun 20 14:56:51 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:51 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.129@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:51.193128 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.188192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.129:53367)
0620 14:56:51.188420 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:51.188432 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:51.188487 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:51.188648 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:51.188649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:51.188852 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:51.188901 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.188903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.189579 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.189580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.190138 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.190140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.190543 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.190544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.190589 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.191071 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:51.191076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:51.193071 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":115,"threads_started":1}
W20260620 14:56:51.193307 21954 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:51.188354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:53367 (local address 127.12.116.190:40599)
0620 14:56:51.188493 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:51.188495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:51.188524 (+ 29us) server_negotiation.cc:407] Connection header received
0620 14:56:51.188546 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:51.188547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:51.188558 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:51.188609 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:51.188985 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.189490 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.190242 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.190451 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.190519 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.193222 (+ 2703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.129:53367: BlockingRecv error: recv got EOF from 127.12.116.129:53367 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
Jun 20 14:56:51 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
Jun 20 14:56:51 dist-test-slave-7v06 krb5kdc[20896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.116.130@KRBTEST.COM for oryx/127.12.116.190@KRBTEST.COM, Server not found in Kerberos database
I20260620 14:56:51.312152 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.305466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40599 (local address 127.12.116.130:47253)
0620 14:56:51.305845 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:51.305858 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:51.305936 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:51.306299 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:51.306301 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:51.306550 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:51.306650 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.306653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.307608 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.307611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.308479 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.308483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.309148 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.309149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.309234 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.309853 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:51.309859 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:51.312071 (+ 2212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.116.190:40599: Server oryx/127.12.116.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":219,"threads_started":1}
W20260620 14:56:51.312328 21954 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:51.305716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:47253 (local address 127.12.116.190:40599)
0620 14:56:51.305784 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:51.305786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:51.305979 (+ 193us) server_negotiation.cc:407] Connection header received
0620 14:56:51.306018 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:51.306019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:51.306032 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:51.306093 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:51.306813 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.307455 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.308741 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.309033 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.309110 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.312215 (+ 3105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.116.130:47253: BlockingRecv error: recv got EOF from 127.12.116.130:47253 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 14:56:51.359998 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21479
I20260620 14:56:51.365784 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21630
I20260620 14:56:51.370980 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21763
I20260620 14:56:51.376403 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21409
2026-06-20T14:56:51Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17850 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-06-20T14:56:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:51Z Disabled control of system clock
I20260620 14:56:51.410084 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40745
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:40745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260620 14:56:51.506434 21959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:51.506688 21959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:51.506713 21959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:51.508065 21959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:51.508121 21959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:51.508134 21959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:51.508148 21959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:51.508160 21959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:51.509654 21959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:40745
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:40745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:51.509905 21959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:51.510185 21959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:51.515946 21964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:51.516829 21967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:51.517182 21959 server_base.cc:1034] running on GCE node
W20260620 14:56:51.517554 21965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:51.517925 21959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:51.518327 21959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:51.519524 21959 hybrid_clock.cc:648] HybridClock initialized: now 1781967411519501 us; error 55 us; skew 500 ppm
I20260620 14:56:51.521564 21959 webserver.cc:460] Webserver started at http://127.12.116.190:40007/ using document root <none> and password file <none>
I20260620 14:56:51.522337 21959 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:51.522502 21959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:51.522725 21959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:51.524331 21959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "126d78d5090c4ca399ed20e34feec53a"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "b684c153181dc4d2fbd3c2d94ec77c07"
server_key_iv: "e15f7e656fb0d499405b64d5dbe3479a"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.524901 21959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "126d78d5090c4ca399ed20e34feec53a"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "b684c153181dc4d2fbd3c2d94ec77c07"
server_key_iv: "e15f7e656fb0d499405b64d5dbe3479a"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.526695 21959 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:56:51.527897 21973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.528157 21959 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:51.528291 21959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "126d78d5090c4ca399ed20e34feec53a"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "b684c153181dc4d2fbd3c2d94ec77c07"
server_key_iv: "e15f7e656fb0d499405b64d5dbe3479a"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.528649 21959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:51.545411 21959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:51.545820 21959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:51.545990 21959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:51.550693 21959 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:40745
I20260620 14:56:51.550734 22025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:40745 every 8 connection(s)
I20260620 14:56:51.551295 21959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:51.552129 22026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:51.555955 22026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a: Bootstrap starting.
I20260620 14:56:51.557004 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 21959
I20260620 14:56:51.557150 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:51.557129 22026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:51.557380 12754 external_mini_cluster.cc:1428] Setting key 9caeeb793237eef8d1f9e8f364ed562d
I20260620 14:56:51.557840 22026 log.cc:824] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:51.558847 22026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a: No bootstrap required, opened a new log
I20260620 14:56:51.560662 22026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126d78d5090c4ca399ed20e34feec53a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40745 } }
I20260620 14:56:51.560878 22026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:51.560930 22026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126d78d5090c4ca399ed20e34feec53a, State: Initialized, Role: FOLLOWER
I20260620 14:56:51.561120 22026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126d78d5090c4ca399ed20e34feec53a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40745 } }
I20260620 14:56:51.561456 22026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:51.561509 22026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:51.561561 22026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:51.562327 22026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126d78d5090c4ca399ed20e34feec53a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40745 } }
I20260620 14:56:51.562474 22026 leader_election.cc:302] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 126d78d5090c4ca399ed20e34feec53a; no voters:
I20260620 14:56:51.562700 22026 leader_election.cc:288] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:51.562891 22031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:51.563057 22026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:51.563114 22031 raft_consensus.cc:686] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [term 1 LEADER]: Becoming Leader. State: Replica: 126d78d5090c4ca399ed20e34feec53a, State: Running, Role: LEADER
I20260620 14:56:51.563337 22031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126d78d5090c4ca399ed20e34feec53a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40745 } }
I20260620 14:56:51.563746 22032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "126d78d5090c4ca399ed20e34feec53a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126d78d5090c4ca399ed20e34feec53a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40745 } } }
I20260620 14:56:51.563838 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.558082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43632 (local address 127.12.116.190:40745)
0620 14:56:51.558299 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:51.558309 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:51.558349 (+ 40us) server_negotiation.cc:407] Connection header received
0620 14:56:51.559006 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:51.559015 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:51.559086 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:51.559261 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:51.559520 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.560542 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.561462 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.562003 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.562153 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.563001 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:51.563006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:51.563006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:51.563237 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:51.563285 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:51.563301 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:51.563358 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:51.563516 (+ 158us) server_negotiation.cc:299] Negotiation successful
0620 14:56:51.563609 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260620 14:56:51.563840 22032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:51.564930 22041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:51.564944 22033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 126d78d5090c4ca399ed20e34feec53a. Latest consensus state: current_term: 1 leader_uuid: "126d78d5090c4ca399ed20e34feec53a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126d78d5090c4ca399ed20e34feec53a" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 40745 } } }
I20260620 14:56:51.565219 22033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:51.565856 22041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:51.567595 22041 catalog_manager.cc:1347] Generated new cluster ID: 05dece1ec2b64c8199dc3238b5f9905c
I20260620 14:56:51.567682 22041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:51.585934 22041 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:51.586560 22041 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:51.602802 22041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 126d78d5090c4ca399ed20e34feec53a: Generated new TSK 0
I20260620 14:56:51.603055 22041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:51.615993 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40745
--builtin_ntp_servers=127.12.116.148:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260620 14:56:51.709048 22051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:51.709295 22051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:51.709322 22051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:51.710729 22051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:51.710798 22051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:51.710830 22051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:51.712635 22051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:51.713035 22051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:51.713595 22051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:51.719578 22056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:51.719617 22057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:51.719578 22059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:51.719962 22051 server_base.cc:1034] running on GCE node
I20260620 14:56:51.720235 22051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:51.720603 22051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:51.721933 22051 hybrid_clock.cc:648] HybridClock initialized: now 1781967411721836 us; error 86 us; skew 500 ppm
I20260620 14:56:51.724277 22051 webserver.cc:460] Webserver started at http://127.12.116.129:40535/ using document root <none> and password file <none>
I20260620 14:56:51.724655 22051 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:51.724711 22051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:51.724829 22051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:51.726037 22051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "1532df708a02435391d53f9dd37dc3cd"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "d0ab0ac8a7ac06326c101018647ce978"
server_key_iv: "aa427052753d8327cd5fa0514fcf3037"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.726384 22051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "1532df708a02435391d53f9dd37dc3cd"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "d0ab0ac8a7ac06326c101018647ce978"
server_key_iv: "aa427052753d8327cd5fa0514fcf3037"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.727988 22051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:51.729357 22065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.729693 22051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:56:51.729832 22051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "1532df708a02435391d53f9dd37dc3cd"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "d0ab0ac8a7ac06326c101018647ce978"
server_key_iv: "aa427052753d8327cd5fa0514fcf3037"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.729946 22051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:51.743569 22051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:51.744091 22051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:51.744292 22051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:51.744645 22051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:51.745023 22051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:51.745080 22051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.745126 22051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:51.745159 22051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.752542 22051 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:45101
I20260620 14:56:51.752733 22178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:45101 every 8 connection(s)
I20260620 14:56:51.753064 22051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:51.760632 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.753992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:48979 (local address 127.12.116.190:40745)
0620 14:56:51.754054 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:51.754056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:51.754354 (+ 298us) server_negotiation.cc:407] Connection header received
0620 14:56:51.754994 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:51.754996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:51.755023 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:51.755138 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:51.756180 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.756878 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.758421 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.758662 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.758767 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.760227 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:51.760229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:51.760230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:51.760238 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:51.760259 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:51.760265 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:51.760363 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:51.760517 (+ 154us) server_negotiation.cc:299] Negotiation successful
0620 14:56:51.760558 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 14:56:51.760923 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.753980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40745 (local address 127.12.116.129:48979)
0620 14:56:51.754222 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:51.754259 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:51.754807 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:51.755313 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:51.755319 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:51.755333 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:51.756028 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.756035 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.757206 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.757207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.758191 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.758196 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.758824 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.758825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.759012 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.759938 (+ 926us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:51.759938 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:51.759977 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:51.760009 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:51.760424 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:51.760431 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:51.760434 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:51.760503 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 14:56:51.760618 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":97,"threads_started":1}
I20260620 14:56:51.761646 22179 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40745
I20260620 14:56:51.761770 22179 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:51.761945 22179 heartbeater.cc:511] Master 127.12.116.190:40745 requested a full tablet report, sending...
I20260620 14:56:51.762768 21990 ts_manager.cc:194] Registered new tserver with Master: 1532df708a02435391d53f9dd37dc3cd (127.12.116.129:45101)
I20260620 14:56:51.762929 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22051
I20260620 14:56:51.763069 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:51.763553 12754 external_mini_cluster.cc:1428] Setting key fa8120e28d862c18463a3a324e56c352
I20260620 14:56:51.763978 21990 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.129:48979
I20260620 14:56:51.765156 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40745
--builtin_ntp_servers=127.12.116.148:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260620 14:56:51.862968 22182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:51.863415 22182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:51.863484 22182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:51.865083 22182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:51.865145 22182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:51.865197 22182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:51.866753 22182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:51.867084 22182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:51.867475 22182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:51.873147 22190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:51.873132 22188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:51.873131 22187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:51.873163 22182 server_base.cc:1034] running on GCE node
I20260620 14:56:51.873705 22182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:51.873996 22182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:51.875165 22182 hybrid_clock.cc:648] HybridClock initialized: now 1781967411875146 us; error 31 us; skew 500 ppm
I20260620 14:56:51.876973 22182 webserver.cc:460] Webserver started at http://127.12.116.130:34463/ using document root <none> and password file <none>
I20260620 14:56:51.877281 22182 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:51.877336 22182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:51.877522 22182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:51.878692 22182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "84dc3205195646639149934408f0792f"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "a775d295e5db8e2157b60ca160ebacef"
server_key_iv: "834c831dbbd76dedf13d8e02f5123182"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.879099 22182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "84dc3205195646639149934408f0792f"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "a775d295e5db8e2157b60ca160ebacef"
server_key_iv: "834c831dbbd76dedf13d8e02f5123182"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.880906 22182 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 14:56:51.882002 22196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.882253 22182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:51.882354 22182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "84dc3205195646639149934408f0792f"
format_stamp: "Formatted at 2026-06-20 14:56:51 on dist-test-slave-7v06"
server_key: "a775d295e5db8e2157b60ca160ebacef"
server_key_iv: "834c831dbbd76dedf13d8e02f5123182"
server_key_version: "encryptionkey@0"
I20260620 14:56:51.882423 22182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:51.897279 22182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:51.897605 22182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:51.897716 22182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:51.897912 22182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:51.898299 22182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:51.898346 22182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.898372 22182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:51.898422 22182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:51.904894 22182 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:37703
I20260620 14:56:51.904997 22309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:37703 every 8 connection(s)
I20260620 14:56:51.905370 22182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:51.912091 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.906392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:39023 (local address 127.12.116.190:40745)
0620 14:56:51.906706 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:51.906709 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:51.906973 (+ 264us) server_negotiation.cc:407] Connection header received
0620 14:56:51.907590 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:51.907591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:51.907607 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:51.907661 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:51.908520 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.909077 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.910269 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.910496 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.910597 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.911722 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:51.911723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:51.911724 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:51.911730 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:51.911749 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:51.911754 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:51.911825 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:51.911947 (+ 122us) server_negotiation.cc:299] Negotiation successful
0620 14:56:51.911984 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260620 14:56:51.912411 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:51.906298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40745 (local address 127.12.116.130:39023)
0620 14:56:51.906830 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:51.906868 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:51.907454 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:51.907747 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:51.907751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:51.907759 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:51.908290 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.908294 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.909220 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.909221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.910142 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:51.910145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:51.910611 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:51.910612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:51.910787 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:51.911515 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:51.911516 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:51.911553 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:51.911583 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:51.911841 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:51.911847 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:51.911851 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:51.911951 (+ 100us) client_negotiation.cc:240] Negotiation successful
0620 14:56:51.912085 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":120,"threads_started":1}
I20260620 14:56:51.912568 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22182
I20260620 14:56:51.912710 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:51.913120 12754 external_mini_cluster.cc:1428] Setting key 8d5ff8bfcff1a40b7d9c268b4ac186c5
I20260620 14:56:51.913312 22310 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40745
I20260620 14:56:51.913448 22310 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:51.913712 22310 heartbeater.cc:511] Master 127.12.116.190:40745 requested a full tablet report, sending...
I20260620 14:56:51.914429 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40745
--builtin_ntp_servers=127.12.116.148:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260620 14:56:51.914621 21989 ts_manager.cc:194] Registered new tserver with Master: 84dc3205195646639149934408f0792f (127.12.116.130:37703)
I20260620 14:56:51.915211 21989 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.130:39023
W20260620 14:56:52.019235 22313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:52.019503 22313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:52.019542 22313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:52.020906 22313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:52.020987 22313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:52.021032 22313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:52.022563 22313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:40745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:52.022888 22313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:52.023236 22313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:52.028759 22319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.028786 22321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.028898 22318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:52.029045 22313 server_base.cc:1034] running on GCE node
I20260620 14:56:52.029341 22313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:52.029587 22313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:52.030753 22313 hybrid_clock.cc:648] HybridClock initialized: now 1781967412030726 us; error 44 us; skew 500 ppm
I20260620 14:56:52.032280 22313 webserver.cc:460] Webserver started at http://127.12.116.131:38175/ using document root <none> and password file <none>
I20260620 14:56:52.032575 22313 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:52.032661 22313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:52.032823 22313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:52.034015 22313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "30d21ddf0dc34d3ab44e426772657ba5"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "88d827006e7a08eb6a5960a30e5709e0"
server_key_iv: "efd419030331f6a3ab4c2c3e38df428e"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.034451 22313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "30d21ddf0dc34d3ab44e426772657ba5"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "88d827006e7a08eb6a5960a30e5709e0"
server_key_iv: "efd419030331f6a3ab4c2c3e38df428e"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.035995 22313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 14:56:52.036926 22327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.037184 22313 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 14:56:52.037359 22313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "30d21ddf0dc34d3ab44e426772657ba5"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "88d827006e7a08eb6a5960a30e5709e0"
server_key_iv: "efd419030331f6a3ab4c2c3e38df428e"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.037451 22313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:52.054800 22313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:52.055181 22313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:52.055357 22313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:52.055630 22313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:52.056012 22313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:52.056073 22313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.056120 22313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:52.056155 22313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.065207 22313 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:33059
I20260620 14:56:52.065447 22440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:33059 every 8 connection(s)
I20260620 14:56:52.065702 22313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:52.072753 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22313
I20260620 14:56:52.072896 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:52.073123 12754 external_mini_cluster.cc:1428] Setting key a2f20d2a445022c140734a89247d23ca
I20260620 14:56:52.073463 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.066782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:44679 (local address 127.12.116.190:40745)
0620 14:56:52.066901 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.066904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.067324 (+ 420us) server_negotiation.cc:407] Connection header received
0620 14:56:52.068066 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.068068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.068083 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.068173 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.069330 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:52.069908 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:52.071134 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:52.071399 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:52.071529 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:52.072870 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:52.072874 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:52.072875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:52.072884 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:52.072912 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:52.072919 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:52.073175 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:52.073312 (+ 137us) server_negotiation.cc:299] Negotiation successful
0620 14:56:52.073351 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260620 14:56:52.073810 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.066793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:40745 (local address 127.12.116.131:44679)
0620 14:56:52.067128 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:52.067182 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:52.067916 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:52.068417 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:52.068424 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:52.068444 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:52.069092 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:52.069100 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:52.070029 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:52.070030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:52.070951 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:52.070954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:52.071578 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:52.071579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:52.071750 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:52.072589 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:52.072589 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:52.072637 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:52.072675 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:52.073177 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:52.073185 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:52.073189 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:52.073280 (+ 91us) client_negotiation.cc:240] Negotiation successful
0620 14:56:52.073437 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":113,"threads_started":1}
I20260620 14:56:52.074322 22441 heartbeater.cc:347] Connected to a master server at 127.12.116.190:40745
I20260620 14:56:52.074447 22441 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:52.074661 22441 heartbeater.cc:511] Master 127.12.116.190:40745 requested a full tablet report, sending...
I20260620 14:56:52.075171 21989 ts_manager.cc:194] Registered new tserver with Master: 30d21ddf0dc34d3ab44e426772657ba5 (127.12.116.131:33059)
I20260620 14:56:52.075649 21989 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.131:44679
I20260620 14:56:52.086937 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260620 14:56:52.089425 22030 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:52.088842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.12.116.190:40745)
0620 14:56:52.088939 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.088943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.088956 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:56:52.089032 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.089033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.089045 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.089147 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.089324 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43640: BlockingRecv error: recv got EOF from 127.0.0.1:43640 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260620 14:56:52.089877 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22051
I20260620 14:56:52.096282 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22182
I20260620 14:56:52.101764 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22313
I20260620 14:56:52.107724 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 21959
2026-06-20T14:56:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (727 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-06-20T14:56:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:52Z Disabled control of system clock
I20260620 14:56:52.138365 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37487
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:46077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260620 14:56:52.234709 22452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:52.235049 22452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:52.235081 22452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:52.237293 22452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:52.237381 22452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:52.237396 22452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:52.237411 22452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:52.237424 22452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:52.240103 22452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37487
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:52.240568 22452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:52.240967 22452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:52.247406 22460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.247385 22458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.247411 22457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:52.247566 22452 server_base.cc:1034] running on GCE node
I20260620 14:56:52.247893 22452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:52.248265 22452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:52.249559 22452 hybrid_clock.cc:648] HybridClock initialized: now 1781967412249530 us; error 36 us; skew 500 ppm
I20260620 14:56:52.251873 22452 webserver.cc:460] Webserver started at http://127.12.116.190:43281/ using document root <none> and password file <none>
I20260620 14:56:52.252255 22452 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:52.252380 22452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:52.252557 22452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:52.254168 22452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "d93cfd64ccf04af79f4f2e634d402128"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "01b302fa0076f55076ab35e0369090eb"
server_key_iv: "a5f1654da9907fd08afae7f6d9beb218"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.254642 22452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "d93cfd64ccf04af79f4f2e634d402128"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "01b302fa0076f55076ab35e0369090eb"
server_key_iv: "a5f1654da9907fd08afae7f6d9beb218"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.256912 22452 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 14:56:52.258257 22466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.258687 22452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:52.258935 22452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "d93cfd64ccf04af79f4f2e634d402128"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "01b302fa0076f55076ab35e0369090eb"
server_key_iv: "a5f1654da9907fd08afae7f6d9beb218"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.259071 22452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:52.264576 22452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:52.265158 22452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:52.265592 22452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:52.271340 22452 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:37487
I20260620 14:56:52.271389 22518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:37487 every 8 connection(s)
I20260620 14:56:52.271832 22452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:52.272806 22519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:52.275581 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22452
I20260620 14:56:52.275702 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:52.275928 12754 external_mini_cluster.cc:1428] Setting key 2b9928d02a5cdf7a5c811fca1cbabac1
I20260620 14:56:52.276201 22519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128: Bootstrap starting.
I20260620 14:56:52.277101 22519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:52.277451 22519 log.cc:824] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:52.278352 22519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128: No bootstrap required, opened a new log
I20260620 14:56:52.278988 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.276689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.12.116.190:37487)
0620 14:56:52.276963 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.276988 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.277016 (+ 28us) server_negotiation.cc:407] Connection header received
0620 14:56:52.277601 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.277609 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.277654 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.277790 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.278517 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:52.278522 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:52.278522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:52.278530 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:52.278585 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:52.278596 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:52.278701 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:52.278738 (+ 37us) server_negotiation.cc:299] Negotiation successful
0620 14:56:52.278817 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":153,"threads_started":1}
I20260620 14:56:52.280218 22519 raft_consensus.cc:348] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93cfd64ccf04af79f4f2e634d402128" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37487 } }
I20260620 14:56:52.280469 22519 raft_consensus.cc:374] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:52.280520 22519 raft_consensus.cc:729] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d93cfd64ccf04af79f4f2e634d402128, State: Initialized, Role: FOLLOWER
I20260620 14:56:52.280678 22519 consensus_queue.cc:260] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93cfd64ccf04af79f4f2e634d402128" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37487 } }
I20260620 14:56:52.280768 22519 raft_consensus.cc:388] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:52.280820 22519 raft_consensus.cc:482] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:52.280872 22519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:52.281875 22519 raft_consensus.cc:504] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93cfd64ccf04af79f4f2e634d402128" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37487 } }
I20260620 14:56:52.282011 22519 leader_election.cc:302] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d93cfd64ccf04af79f4f2e634d402128; no voters:
I20260620 14:56:52.282245 22519 leader_election.cc:288] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:52.282375 22524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:52.282544 22519 sys_catalog.cc:564] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:52.282558 22524 raft_consensus.cc:686] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [term 1 LEADER]: Becoming Leader. State: Replica: d93cfd64ccf04af79f4f2e634d402128, State: Running, Role: LEADER
I20260620 14:56:52.282719 22524 consensus_queue.cc:237] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93cfd64ccf04af79f4f2e634d402128" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37487 } }
I20260620 14:56:52.283135 22525 sys_catalog.cc:455] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d93cfd64ccf04af79f4f2e634d402128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93cfd64ccf04af79f4f2e634d402128" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37487 } } }
I20260620 14:56:52.283247 22525 sys_catalog.cc:458] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:52.283419 22526 sys_catalog.cc:455] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d93cfd64ccf04af79f4f2e634d402128. Latest consensus state: current_term: 1 leader_uuid: "d93cfd64ccf04af79f4f2e634d402128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93cfd64ccf04af79f4f2e634d402128" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37487 } } }
I20260620 14:56:52.283489 22526 sys_catalog.cc:458] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128 [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:52.284271 22533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:56:52.284966 22533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:52.287464 22533 catalog_manager.cc:1347] Generated new cluster ID: 19cb84c19e604143909ea4d29a2cdfb3
I20260620 14:56:52.287565 22533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:52.298703 22533 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:52.298967 22533 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:52.304877 22533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d93cfd64ccf04af79f4f2e634d402128: Generated new TSK 0
I20260620 14:56:52.305199 22533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:56:52.315599 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37487
--builtin_ntp_servers=127.12.116.148:46077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260620 14:56:52.414067 22543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:52.414368 22543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:52.414410 22543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:52.415839 22543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:52.415938 22543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:52.415992 22543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:52.417706 22543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:52.418074 22543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:52.418429 22543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:52.426052 22549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.426075 22551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.426596 22548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:52.426774 22543 server_base.cc:1034] running on GCE node
I20260620 14:56:52.427155 22543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:52.427536 22543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:52.428887 22543 hybrid_clock.cc:648] HybridClock initialized: now 1781967412428857 us; error 49 us; skew 500 ppm
I20260620 14:56:52.430590 22543 webserver.cc:460] Webserver started at http://127.12.116.129:40381/ using document root <none> and password file <none>
I20260620 14:56:52.430915 22543 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:52.431003 22543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:52.431182 22543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:52.432512 22543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "1eb0e090a5c448e9a30f4d6d83137f68"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "ea9347d144400b9b7f5cae34fc85de2d"
server_key_iv: "a58131d07c66a03fcb866472fab37a53"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.432934 22543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "1eb0e090a5c448e9a30f4d6d83137f68"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "ea9347d144400b9b7f5cae34fc85de2d"
server_key_iv: "a58131d07c66a03fcb866472fab37a53"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.434553 22543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:56:52.435652 22557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.435925 22543 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:52.436060 22543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "1eb0e090a5c448e9a30f4d6d83137f68"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "ea9347d144400b9b7f5cae34fc85de2d"
server_key_iv: "a58131d07c66a03fcb866472fab37a53"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.436144 22543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:52.440215 22543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:52.440557 22543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:52.440718 22543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:52.440968 22543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:52.441310 22543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:52.441367 22543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.441413 22543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:52.441445 22543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.447964 22543 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:42451
I20260620 14:56:52.448058 22670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:42451 every 8 connection(s)
I20260620 14:56:52.448505 22543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:52.451650 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22543
I20260620 14:56:52.451768 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:52.452075 12754 external_mini_cluster.cc:1428] Setting key c0b96dfb6e6a21b15576841ed6aff407
I20260620 14:56:52.452152 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.449413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:55133 (local address 127.12.116.190:37487)
0620 14:56:52.449481 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.449483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.449695 (+ 212us) server_negotiation.cc:407] Connection header received
0620 14:56:52.450272 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.450273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.450280 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.450330 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.451823 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:52.451826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:52.451826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:52.451832 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:52.451851 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:52.451857 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:52.451936 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:52.452058 (+ 122us) server_negotiation.cc:299] Negotiation successful
0620 14:56:52.452076 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 14:56:52.452520 22673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.449345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37487 (local address 127.12.116.129:55133)
0620 14:56:52.449571 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:52.449608 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:52.450160 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:52.450402 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:52.450406 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:52.450416 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:52.451521 (+ 1105us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:52.451522 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:52.451565 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:52.451619 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:52.451946 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:52.451954 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:52.451957 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:52.452073 (+ 116us) client_negotiation.cc:240] Negotiation successful
0620 14:56:52.452148 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
I20260620 14:56:52.453058 22671 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37487
I20260620 14:56:52.453172 22671 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:52.453317 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37487
--builtin_ntp_servers=127.12.116.148:46077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260620 14:56:52.453332 22671 heartbeater.cc:511] Master 127.12.116.190:37487 requested a full tablet report, sending...
I20260620 14:56:52.453917 22483 ts_manager.cc:194] Registered new tserver with Master: 1eb0e090a5c448e9a30f4d6d83137f68 (127.12.116.129:42451)
W20260620 14:56:52.546176 22674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:52.546509 22674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:52.546545 22674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:52.548132 22674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:52.548206 22674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:52.548238 22674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:52.549957 22674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:52.550225 22674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:52.550531 22674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:52.556480 22682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.556663 22679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:52.556876 22674 server_base.cc:1034] running on GCE node
W20260620 14:56:52.556936 22680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:52.557263 22674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:52.557579 22674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:52.558815 22674 hybrid_clock.cc:648] HybridClock initialized: now 1781967412558807 us; error 45 us; skew 500 ppm
I20260620 14:56:52.560523 22674 webserver.cc:460] Webserver started at http://127.12.116.130:46625/ using document root <none> and password file <none>
I20260620 14:56:52.560796 22674 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:52.560850 22674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:52.560964 22674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:52.562216 22674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "94ac91e2c7514bfe840daa0ae9aba887"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "db21f576206c6bbd7f3ff212e18e209c"
server_key_iv: "471b494f5ebe224401a8aa11b223f5eb"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.562563 22674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "94ac91e2c7514bfe840daa0ae9aba887"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "db21f576206c6bbd7f3ff212e18e209c"
server_key_iv: "471b494f5ebe224401a8aa11b223f5eb"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.564157 22674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:56:52.565204 22688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.565536 22674 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:52.565675 22674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "94ac91e2c7514bfe840daa0ae9aba887"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "db21f576206c6bbd7f3ff212e18e209c"
server_key_iv: "471b494f5ebe224401a8aa11b223f5eb"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.565797 22674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:52.569823 22674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:52.570204 22674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:52.570367 22674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:52.570611 22674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:52.570960 22674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:52.570995 22674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.571019 22674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:52.571033 22674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.577529 22674 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:34039
I20260620 14:56:52.577565 22801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:34039 every 8 connection(s)
I20260620 14:56:52.577955 22674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:52.579288 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22674
I20260620 14:56:52.579439 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:52.579667 12754 external_mini_cluster.cc:1428] Setting key f10bdf5c0a4641975515d838cba40ab6
I20260620 14:56:52.580857 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37487
--builtin_ntp_servers=127.12.116.148:46077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260620 14:56:52.582283 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.578993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:60433 (local address 127.12.116.190:37487)
0620 14:56:52.579065 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.579068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.579473 (+ 405us) server_negotiation.cc:407] Connection header received
0620 14:56:52.580231 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.580233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.580240 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.580440 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.581885 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:52.581887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:52.581887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:52.581895 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:52.581913 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:52.581919 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:52.582010 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:52.582157 (+ 147us) server_negotiation.cc:299] Negotiation successful
0620 14:56:52.582179 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 14:56:52.582530 22804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.578963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37487 (local address 127.12.116.130:60433)
0620 14:56:52.579244 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:52.579307 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:52.580090 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:52.580545 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:52.580551 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:52.580563 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:52.581674 (+ 1111us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:52.581675 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:52.581720 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:52.581756 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:52.582043 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:52.582052 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:52.582056 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:52.582151 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 14:56:52.582242 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":130,"threads_started":1}
I20260620 14:56:52.583269 22802 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37487
I20260620 14:56:52.583555 22802 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:52.583788 22802 heartbeater.cc:511] Master 127.12.116.190:37487 requested a full tablet report, sending...
I20260620 14:56:52.584256 22483 ts_manager.cc:194] Registered new tserver with Master: 94ac91e2c7514bfe840daa0ae9aba887 (127.12.116.130:34039)
W20260620 14:56:52.678445 22805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:52.678705 22805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:52.678733 22805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:52.680162 22805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:52.680243 22805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:52.680277 22805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:52.682025 22805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:52.682376 22805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:52.682724 22805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:52.689332 22810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.689329 22811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:52.689329 22813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:52.689375 22805 server_base.cc:1034] running on GCE node
I20260620 14:56:52.689960 22805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:52.690272 22805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:52.691501 22805 hybrid_clock.cc:648] HybridClock initialized: now 1781967412691471 us; error 49 us; skew 500 ppm
I20260620 14:56:52.693199 22805 webserver.cc:460] Webserver started at http://127.12.116.131:36073/ using document root <none> and password file <none>
I20260620 14:56:52.693495 22805 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:52.693576 22805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:52.693738 22805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:52.695469 22805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "0d93599340c54e02809326666d3adcad"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "01071876c67aee8262b57facc5970b00"
server_key_iv: "77dbb3bc99fc1dc9bbe5b2d76f13e06d"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.695917 22805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "0d93599340c54e02809326666d3adcad"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "01071876c67aee8262b57facc5970b00"
server_key_iv: "77dbb3bc99fc1dc9bbe5b2d76f13e06d"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.698165 22805 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 14:56:52.699504 22819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.699949 22805 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:56:52.700218 22805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "0d93599340c54e02809326666d3adcad"
format_stamp: "Formatted at 2026-06-20 14:56:52 on dist-test-slave-7v06"
server_key: "01071876c67aee8262b57facc5970b00"
server_key_iv: "77dbb3bc99fc1dc9bbe5b2d76f13e06d"
server_key_version: "encryptionkey@0"
I20260620 14:56:52.700369 22805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:52.705437 22805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:52.705848 22805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:52.706017 22805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:52.706290 22805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:52.706708 22805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:52.706768 22805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.706807 22805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:52.706836 22805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:52.713840 22805 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:36061
I20260620 14:56:52.714040 22932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:36061 every 8 connection(s)
I20260620 14:56:52.714377 22805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:52.718214 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.715523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:43069 (local address 127.12.116.190:37487)
0620 14:56:52.715628 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.715630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.715796 (+ 166us) server_negotiation.cc:407] Connection header received
0620 14:56:52.716404 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.716407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.716422 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.716487 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.717876 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:52.717877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:52.717877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 14:56:52.717882 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:52.717896 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 14:56:52.717900 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:52.717970 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:52.718119 (+ 149us) server_negotiation.cc:299] Negotiation successful
0620 14:56:52.718133 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260620 14:56:52.718236 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22805
I20260620 14:56:52.718333 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:52.718499 22935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:52.715357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37487 (local address 127.12.116.131:43069)
0620 14:56:52.715607 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:52.715654 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:52.716173 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:52.716682 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:52.716686 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:52.716696 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:52.717694 (+ 998us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 14:56:52.717695 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:52.717732 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 14:56:52.717765 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:52.718011 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:52.718019 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:52.718023 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:52.718132 (+ 109us) client_negotiation.cc:240] Negotiation successful
0620 14:56:52.718242 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":97,"threads_started":1}
I20260620 14:56:52.718554 12754 external_mini_cluster.cc:1428] Setting key 2b2d325cec50c4a8489f5586efbd212a
I20260620 14:56:52.719282 22933 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37487
I20260620 14:56:52.719376 22933 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:52.719497 22933 heartbeater.cc:511] Master 127.12.116.190:37487 requested a full tablet report, sending...
I20260620 14:56:52.719915 22483 ts_manager.cc:194] Registered new tserver with Master: 0d93599340c54e02809326666d3adcad (127.12.116.131:36061)
I20260620 14:56:52.731582 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260620 14:56:52.734104 22522 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:56:52.733470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39242 (local address 127.12.116.190:37487)
0620 14:56:52.733568 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:52.733570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:52.733638 (+ 68us) server_negotiation.cc:407] Connection header received
0620 14:56:52.733747 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:52.733748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:52.733753 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:52.733801 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:52.734000 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39242: BlockingRecv error: recv got EOF from 127.0.0.1:39242 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260620 14:56:52.734206 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22543
I20260620 14:56:52.739046 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22674
I20260620 14:56:52.745172 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22805
I20260620 14:56:52.750459 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22452
2026-06-20T14:56:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (642 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:52 dist-test-slave-7v06 krb5kdc[22943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:52 dist-test-slave-7v06 krb5kdc[22943](info): set up 2 sockets
Jun 20 14:56:52 dist-test-slave-7v06 krb5kdc[22943](info): commencing operation
krb5kdc: starting...
W20260620 14:56:53.883303 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:53 dist-test-slave-7v06 krb5kdc[22943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:56:54.028409 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38917
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:38917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:54.123040 22956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:54.123363 22956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:54.123406 22956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:54.124807 22956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:56:54.124903 22956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:54.124933 22956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:54.124953 22956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:56:54.124984 22956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:56:54.126724 22956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:38917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:54.127069 22956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:54.127341 22956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:54.133579 22961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:54.133615 22962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:54.133872 22956 server_base.cc:1034] running on GCE node
W20260620 14:56:54.134268 22964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:54.134671 22956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:54.134996 22956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:54.136210 22956 hybrid_clock.cc:648] HybridClock initialized: now 1781967414136197 us; error 36 us; skew 500 ppm
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:54.139801 22956 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:56:54.140594 22956 webserver.cc:460] Webserver started at http://127.12.116.190:45113/ using document root <none> and password file <none>
I20260620 14:56:54.140986 22956 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:54.141072 22956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:54.141273 22956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:54.142517 22956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "2f3997b9db184f509ed100bfd8ce0ddc"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "a46bf3a2b8582db03b009e59bea06aeb"
server_key_iv: "ad15e356ce3dbe14bb456007c30594f1"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.142933 22956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "2f3997b9db184f509ed100bfd8ce0ddc"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "a46bf3a2b8582db03b009e59bea06aeb"
server_key_iv: "ad15e356ce3dbe14bb456007c30594f1"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.144578 22956 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 14:56:54.145583 22971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.145910 22956 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:54.146036 22956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "2f3997b9db184f509ed100bfd8ce0ddc"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "a46bf3a2b8582db03b009e59bea06aeb"
server_key_iv: "ad15e356ce3dbe14bb456007c30594f1"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.146121 22956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:54.181130 22956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:54.184211 22956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:54.184502 22956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:54.189709 22956 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:38917
I20260620 14:56:54.189814 23023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:38917 every 8 connection(s)
I20260620 14:56:54.190239 22956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:56:54.191774 23024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:54.195392 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 22956
I20260620 14:56:54.195502 23024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc: Bootstrap starting.
I20260620 14:56:54.195551 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:56:54.195758 12754 external_mini_cluster.cc:1428] Setting key 8e41d9889272079a112ab473948a40c1
I20260620 14:56:54.196421 23024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:54.196764 23024 log.cc:824] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:54.197631 23024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc: No bootstrap required, opened a new log
I20260620 14:56:54.199697 23024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38917 } }
I20260620 14:56:54.199920 23024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:54.200001 23024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3997b9db184f509ed100bfd8ce0ddc, State: Initialized, Role: FOLLOWER
I20260620 14:56:54.200191 23024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38917 } }
I20260620 14:56:54.200311 23024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:56:54.200377 23024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:56:54.200420 23024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:54.201406 23024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38917 } }
I20260620 14:56:54.201552 23024 leader_election.cc:302] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f3997b9db184f509ed100bfd8ce0ddc; no voters:
I20260620 14:56:54.201874 23024 leader_election.cc:288] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:56:54.202013 23029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:54.202322 23024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:56:54.202584 23029 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [term 1 LEADER]: Becoming Leader. State: Replica: 2f3997b9db184f509ed100bfd8ce0ddc, State: Running, Role: LEADER
I20260620 14:56:54.202736 23029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38917 } }
I20260620 14:56:54.203330 23031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38917 } } }
I20260620 14:56:54.203426 23031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:54.203581 23031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f3997b9db184f509ed100bfd8ce0ddc. Latest consensus state: current_term: 1 leader_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3997b9db184f509ed100bfd8ce0ddc" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38917 } } }
I20260620 14:56:54.203655 23031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc [sys.catalog]: This master's current role is: LEADER
I20260620 14:56:54.203902 23040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:54.204890 23040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:56:54.207809 23040 catalog_manager.cc:1347] Generated new cluster ID: 1c1624ba23ea46949b75b372733ddbc6
I20260620 14:56:54.207901 23040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:56:54.209941 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.196444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53290 (local address 127.12.116.190:38917)
0620 14:56:54.196682 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.196691 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.196721 (+ 30us) server_negotiation.cc:407] Connection header received
0620 14:56:54.197299 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.197306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.197364 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.197539 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:54.198292 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.199230 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.200109 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.200865 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.201014 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.205348 (+ 4334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:54.205353 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:54.205354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:54.205369 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:54.207655 (+ 2286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.208213 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.208216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.208217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.208363 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.208595 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.208596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.208596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.208930 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:54.209097 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.209476 (+ 379us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.209660 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":95,"threads_started":1}
I20260620 14:56:54.223434 23040 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:56:54.224197 23040 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:56:54.228037 23040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc: Generated new TSK 0
I20260620 14:56:54.228320 23040 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:56:54.262240 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38917
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:54.355244 23050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:54.355495 23050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:54.355521 23050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:54.356818 23050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:54.356870 23050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:54.356901 23050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:56:54.358660 23050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:54.358909 23050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:54.359107 23050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:54.365005 23055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:54.365039 23058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:54.365280 23056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:54.365468 23050 server_base.cc:1034] running on GCE node
I20260620 14:56:54.365741 23050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:54.366072 23050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:54.367287 23050 hybrid_clock.cc:648] HybridClock initialized: now 1781967414367272 us; error 32 us; skew 500 ppm
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:54.370416 23050 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:56:54.370980 23050 webserver.cc:460] Webserver started at http://127.12.116.129:43237/ using document root <none> and password file <none>
I20260620 14:56:54.371254 23050 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:54.371333 23050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:54.371501 23050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:54.372952 23050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "66369ecaef9646b68a18ba0eaf4760c5"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "c40ed9d5cbadb964baccbefa72b9013d"
server_key_iv: "cb9802206b6fed643d08548d84db8ef0"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.373360 23050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "66369ecaef9646b68a18ba0eaf4760c5"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "c40ed9d5cbadb964baccbefa72b9013d"
server_key_iv: "cb9802206b6fed643d08548d84db8ef0"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.374951 23050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:56:54.376072 23065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.376470 23050 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:54.376608 23050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "66369ecaef9646b68a18ba0eaf4760c5"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "c40ed9d5cbadb964baccbefa72b9013d"
server_key_iv: "cb9802206b6fed643d08548d84db8ef0"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.376709 23050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:54.387439 23050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:54.391583 23050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:54.391742 23050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:54.392074 23050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:54.392663 23050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:54.392719 23050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.392760 23050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:54.392781 23050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.400226 23050 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:37105
I20260620 14:56:54.400435 23178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:37105 every 8 connection(s)
I20260620 14:56:54.400679 23050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:56:54.408650 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 23050
I20260620 14:56:54.408785 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:56:54.409140 12754 external_mini_cluster.cc:1428] Setting key ee24f3ffe187934e90e694d058932b17
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:54.415376 23181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.401722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38917 (local address 127.12.116.129:38287)
0620 14:56:54.401991 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:54.402044 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:54.402842 (+ 798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:54.403118 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:54.403122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:54.403922 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:54.404166 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.404171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.405017 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.405018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.405892 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.405894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.406327 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.406329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.406467 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.407375 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:54.407564 (+ 189us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:54.410281 (+ 2717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:54.413052 (+ 2771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:54.413068 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:54.413072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:54.413566 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:54.413869 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:54.413870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:54.413871 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:54.414048 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:54.414421 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:54.414430 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:54.414645 (+ 215us) client_negotiation.cc:769] Sending connection context
0620 14:56:54.414787 (+ 142us) client_negotiation.cc:240] Negotiation successful
0620 14:56:54.415036 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":129,"threads_started":1}
I20260620 14:56:54.415488 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.401750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:38287 (local address 127.12.116.190:38917)
0620 14:56:54.401840 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.401842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.402157 (+ 315us) server_negotiation.cc:407] Connection header received
0620 14:56:54.402972 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.402973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.402986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.403034 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:54.404307 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.404907 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.405999 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.406228 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.406317 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.410543 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:54.410546 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:54.410546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:54.410557 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:54.412922 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.413703 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.413704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.413704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.413777 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.414157 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.414158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.414158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.414306 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:54.414406 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.414944 (+ 538us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.415281 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260620 14:56:54.416391 23179 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38917
I20260620 14:56:54.416522 23179 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:54.416800 23179 heartbeater.cc:511] Master 127.12.116.190:38917 requested a full tablet report, sending...
I20260620 14:56:54.417492 22988 ts_manager.cc:194] Registered new tserver with Master: 66369ecaef9646b68a18ba0eaf4760c5 (127.12.116.129:37105)
I20260620 14:56:54.418201 22988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:38287
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:56:54.446049 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38917
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:54.550343 23184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:54.550626 23184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:54.550684 23184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:54.552170 23184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:54.552264 23184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:54.552318 23184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:56:54.554288 23184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:54.554643 23184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:54.554931 23184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:54.561630 23190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:54.561630 23189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:54.561905 23192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:54.562264 23184 server_base.cc:1034] running on GCE node
I20260620 14:56:54.562556 23184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:54.563211 23184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:54.564559 23184 hybrid_clock.cc:648] HybridClock initialized: now 1781967414564511 us; error 75 us; skew 500 ppm
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:54.568296 23184 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:56:54.569111 23184 webserver.cc:460] Webserver started at http://127.12.116.130:32855/ using document root <none> and password file <none>
I20260620 14:56:54.569808 23184 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:54.569883 23184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:54.570065 23184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:54.571465 23184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "be3a9bd49cdc462fa319a7695a562ce2"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "b81c92ab6d0093f612425f1c27ec7d72"
server_key_iv: "fc5dc6f46fe9e3f02371121e08be99ac"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.571885 23184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "be3a9bd49cdc462fa319a7695a562ce2"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "b81c92ab6d0093f612425f1c27ec7d72"
server_key_iv: "fc5dc6f46fe9e3f02371121e08be99ac"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.573853 23184 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:56:54.575223 23199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.576229 23184 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 14:56:54.576655 23184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "be3a9bd49cdc462fa319a7695a562ce2"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "b81c92ab6d0093f612425f1c27ec7d72"
server_key_iv: "fc5dc6f46fe9e3f02371121e08be99ac"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.576820 23184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:54.606451 23184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:54.609864 23184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:54.610006 23184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:54.610364 23184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:54.610718 23184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:54.610756 23184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.610783 23184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:54.610797 23184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.617614 23184 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:35691
I20260620 14:56:54.617666 23312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:35691 every 8 connection(s)
I20260620 14:56:54.618057 23184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:56:54.624876 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 23184
I20260620 14:56:54.625015 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:56:54.625241 12754 external_mini_cluster.cc:1428] Setting key 9236b881472ab9dc386875360dc65758
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:54.631018 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.619075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:39745 (local address 127.12.116.190:38917)
0620 14:56:54.619154 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.619157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.619469 (+ 312us) server_negotiation.cc:407] Connection header received
0620 14:56:54.620037 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.620038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.620049 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.620119 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:54.621811 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.622365 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.623953 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.624226 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.624437 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.627190 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:54.627192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:54.627193 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:54.627202 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:54.628951 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.629693 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.629694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.629695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.629757 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.630108 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.630108 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.630109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.630335 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:54.630413 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.630848 (+ 435us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.630939 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 14:56:54.631254 23315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.619051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38917 (local address 127.12.116.130:39745)
0620 14:56:54.619268 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:54.619350 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:54.619896 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:54.620370 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:54.620376 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:54.621171 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:54.621575 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.621587 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.622544 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.622545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.623772 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.623779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.624482 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.624484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.624649 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.625404 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:54.625424 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:54.627067 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:54.629065 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:54.629077 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:54.629080 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:54.629579 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:54.629853 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:54.629854 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:54.629854 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:54.630030 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:54.630432 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:54.630440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:54.630655 (+ 215us) client_negotiation.cc:769] Sending connection context
0620 14:56:54.630799 (+ 144us) client_negotiation.cc:240] Negotiation successful
0620 14:56:54.631010 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":111,"threads_started":1}
I20260620 14:56:54.631918 23313 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38917
I20260620 14:56:54.632051 23313 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:54.632292 23313 heartbeater.cc:511] Master 127.12.116.190:38917 requested a full tablet report, sending...
I20260620 14:56:54.633240 22988 ts_manager.cc:194] Registered new tserver with Master: be3a9bd49cdc462fa319a7695a562ce2 (127.12.116.130:35691)
I20260620 14:56:54.633839 22988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:39745
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:56:54.661578 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38917
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:56:54.757839 23318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:56:54.758073 23318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:56:54.758101 23318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:56:54.759541 23318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:56:54.759598 23318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:56:54.759645 23318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:56:54.761389 23318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:38917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:56:54.761701 23318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:56:54.761953 23318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:56:54.769949 23326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:56:54.769958 23324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:54.770485 23318 server_base.cc:1034] running on GCE node
W20260620 14:56:54.769961 23323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:56:54.770871 23318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:56:54.771178 23318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:56:54.772435 23318 hybrid_clock.cc:648] HybridClock initialized: now 1781967414772345 us; error 92 us; skew 500 ppm
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:56:54.776028 23318 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:56:54.776801 23318 webserver.cc:460] Webserver started at http://127.12.116.131:44623/ using document root <none> and password file <none>
I20260620 14:56:54.777110 23318 fs_manager.cc:359] Metadata directory not provided
I20260620 14:56:54.777194 23318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:56:54.777356 23318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:56:54.778502 23318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "b7150e6a693641f19c8eb5f20cdf1fd5"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "b495438decde29f93204526d5f0d8788"
server_key_iv: "d3edf690dc88e7001f70ba17fbb0cfbd"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.778923 23318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "b7150e6a693641f19c8eb5f20cdf1fd5"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "b495438decde29f93204526d5f0d8788"
server_key_iv: "d3edf690dc88e7001f70ba17fbb0cfbd"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.780876 23318 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 14:56:54.781917 23333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.782196 23318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:56:54.782286 23318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "b7150e6a693641f19c8eb5f20cdf1fd5"
format_stamp: "Formatted at 2026-06-20 14:56:54 on dist-test-slave-7v06"
server_key: "b495438decde29f93204526d5f0d8788"
server_key_iv: "d3edf690dc88e7001f70ba17fbb0cfbd"
server_key_version: "encryptionkey@0"
I20260620 14:56:54.782351 23318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:56:54.813606 23318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:56:54.816175 23318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:56:54.816318 23318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:56:54.816610 23318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:56:54.816962 23318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:56:54.817004 23318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.817028 23318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:56:54.817041 23318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:56:54.823791 23318 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:40101
I20260620 14:56:54.823894 23446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:40101 every 8 connection(s)
I20260620 14:56:54.824254 23318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:56:54.830358 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 23318
I20260620 14:56:54.830488 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:56:54.830686 12754 external_mini_cluster.cc:1428] Setting key 9ebf69a7c6f403d3182e78477527ada2
Jun 20 14:56:54 dist-test-slave-7v06 krb5kdc[22943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:56:54.836170 23449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.825119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:38917 (local address 127.12.116.131:53241)
0620 14:56:54.825311 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:54.825358 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:54.825872 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:54.826145 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:54.826148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:54.826779 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:56:54.826993 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.826997 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.827806 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.827807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.828839 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.828841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.829273 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.829274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.829401 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.830176 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:56:54.830186 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:56:54.831791 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:56:54.834091 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:54.834101 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:54.834104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:54.834381 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:54.834692 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:56:54.834695 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:56:54.834695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:56:54.834953 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:56:54.835463 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:56:54.835474 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:56:54.835662 (+ 188us) client_negotiation.cc:769] Sending connection context
0620 14:56:54.835802 (+ 140us) client_negotiation.cc:240] Negotiation successful
0620 14:56:54.835971 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260620 14:56:54.836187 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.825304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:53241 (local address 127.12.116.190:38917)
0620 14:56:54.825359 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.825361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.825461 (+ 100us) server_negotiation.cc:407] Connection header received
0620 14:56:54.825970 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.825972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.825983 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.826065 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:54.827158 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.827661 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.828956 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.829166 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.829237 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.831953 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:54.831955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:54.831955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:54.831963 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:54.833808 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.834479 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.834480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.834480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.834545 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.835126 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.835128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.835128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.835312 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:54.835421 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.835886 (+ 465us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.835997 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 14:56:54.837172 23447 heartbeater.cc:347] Connected to a master server at 127.12.116.190:38917
I20260620 14:56:54.837320 23447 heartbeater.cc:464] Registering TS with master...
I20260620 14:56:54.837544 23447 heartbeater.cc:511] Master 127.12.116.190:38917 requested a full tablet report, sending...
I20260620 14:56:54.838075 22988 ts_manager.cc:194] Registered new tserver with Master: b7150e6a693641f19c8eb5f20cdf1fd5 (127.12.116.131:40101)
I20260620 14:56:54.838537 22988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:53241
I20260620 14:56:54.843014 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:56:54.854022 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.844589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53296 (local address 127.12.116.190:38917)
0620 14:56:54.844655 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.844657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.844837 (+ 180us) server_negotiation.cc:407] Connection header received
0620 14:56:54.844876 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.844877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.844888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.844955 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:56:54.845642 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.846196 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.847084 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.847306 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.847396 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.850120 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:56:54.850123 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:56:54.850123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:56:54.850142 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:56:54.852167 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.852801 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.852802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.852802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.852874 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:56:54.853272 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:56:54.853273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:56:54.853273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:56:54.853486 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:56:54.853591 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.853856 (+ 265us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.853942 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260620 14:56:54.857573 22988 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:56:54.859349 22988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:56:54.867316 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.862641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.12.116.131:40101)
0620 14:56:54.862959 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.862963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.862975 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:54.863119 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.863123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.863140 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.863214 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:54.863483 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.864673 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.865963 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.866754 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.866866 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.866934 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.867170 (+ 236us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.867218 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":107,"threads_started":1}
I20260620 14:56:54.867334 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.862525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40101 (local address 127.0.0.1:46168)
0620 14:56:54.862860 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:54.862909 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:54.862989 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:54.863321 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:54.863322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:54.863323 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:54.863397 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.863399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.864821 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.864822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.865862 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.865865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.866894 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.866895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.867035 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.867050 (+ 15us) client_negotiation.cc:769] Sending connection context
0620 14:56:54.867141 (+ 91us) client_negotiation.cc:240] Negotiation successful
0620 14:56:54.867234 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":2,"thread_start_us":80,"threads_started":1}
I20260620 14:56:54.868008 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.862647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60168 (local address 127.12.116.129:37105)
0620 14:56:54.862864 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.862870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.863086 (+ 216us) server_negotiation.cc:407] Connection header received
0620 14:56:54.863126 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.863128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.863143 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.863213 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:54.863483 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.864673 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.866147 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.866880 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.866956 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.866997 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.867497 (+ 500us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.867547 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":97,"threads_started":1}
I20260620 14:56:54.868173 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.862850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:35691 (local address 127.0.0.1:54478)
0620 14:56:54.863087 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:54.863099 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:54.863156 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:54.863596 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:54.863597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:54.863599 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:54.863653 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.863655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.864605 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.864606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.866046 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.866049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.867930 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.867931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.867998 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.868003 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:56:54.868051 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 14:56:54.868104 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":47,"thread_start_us":78,"threads_started":1}
I20260620 14:56:54.867334 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.862525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37105 (local address 127.0.0.1:60168)
0620 14:56:54.862860 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:54.862909 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:54.862989 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:54.863295 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:54.863298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:54.863300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:54.863397 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.863399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.864783 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.864783 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.866046 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:54.866049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.866975 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.866976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:54.867030 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.867051 (+ 21us) client_negotiation.cc:769] Sending connection context
0620 14:56:54.867141 (+ 90us) client_negotiation.cc:240] Negotiation successful
0620 14:56:54.867259 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":82,"thread_start_us":89,"threads_started":1}
I20260620 14:56:54.868557 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:54.863070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54478 (local address 127.12.116.130:35691)
0620 14:56:54.863372 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:54.863376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:54.863385 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:56:54.863426 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:54.863428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:54.863443 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:54.863518 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:54.863739 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.864501 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.867034 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:54.867772 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:54.867841 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:54.867896 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:54.868406 (+ 510us) server_negotiation.cc:299] Negotiation successful
0620 14:56:54.868469 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":109,"threads_started":1}
I20260620 14:56:54.868594 23381 tablet_service.cc:1467] Processing CreateTablet for tablet 310dde8a8c1b463091b3ca21169b2341 (DEFAULT_TABLE table=test-table [id=8345c08bed9a41539292c305bce7ec36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:54.869012 23381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310dde8a8c1b463091b3ca21169b2341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:54.869125 23247 tablet_service.cc:1467] Processing CreateTablet for tablet 310dde8a8c1b463091b3ca21169b2341 (DEFAULT_TABLE table=test-table [id=8345c08bed9a41539292c305bce7ec36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:54.869443 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310dde8a8c1b463091b3ca21169b2341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:54.871631 23464 tablet_bootstrap.cc:492] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Bootstrap starting.
I20260620 14:56:54.872283 23465 tablet_bootstrap.cc:492] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Bootstrap starting.
I20260620 14:56:54.872392 23464 tablet_bootstrap.cc:654] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:54.872925 23113 tablet_service.cc:1467] Processing CreateTablet for tablet 310dde8a8c1b463091b3ca21169b2341 (DEFAULT_TABLE table=test-table [id=8345c08bed9a41539292c305bce7ec36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:56:54.873096 23465 tablet_bootstrap.cc:654] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:54.873358 23113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310dde8a8c1b463091b3ca21169b2341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:56:54.873517 23464 log.cc:824] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:54.873682 23465 log.cc:824] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:54.874502 23465 tablet_bootstrap.cc:492] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: No bootstrap required, opened a new log
I20260620 14:56:54.874509 23464 tablet_bootstrap.cc:492] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: No bootstrap required, opened a new log
I20260620 14:56:54.874589 23464 ts_tablet_manager.cc:1397] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:56:54.874732 23465 ts_tablet_manager.cc:1397] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:56:54.876304 23468 tablet_bootstrap.cc:492] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: Bootstrap starting.
I20260620 14:56:54.876776 23464 raft_consensus.cc:348] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:54.877022 23468 tablet_bootstrap.cc:654] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: Neither blocks nor log segments found. Creating new log.
I20260620 14:56:54.876989 23464 raft_consensus.cc:374] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:54.877151 23464 raft_consensus.cc:729] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7150e6a693641f19c8eb5f20cdf1fd5, State: Initialized, Role: FOLLOWER
I20260620 14:56:54.877125 23465 raft_consensus.cc:348] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:54.877334 23465 raft_consensus.cc:374] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:54.877368 23465 raft_consensus.cc:729] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3a9bd49cdc462fa319a7695a562ce2, State: Initialized, Role: FOLLOWER
I20260620 14:56:54.877322 23464 consensus_queue.cc:260] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:54.877494 23465 consensus_queue.cc:260] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:54.877668 23464 ts_tablet_manager.cc:1428] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260620 14:56:54.877732 23447 heartbeater.cc:503] Master 127.12.116.190:38917 was elected leader, sending a full tablet report...
I20260620 14:56:54.877698 23468 log.cc:824] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: Log is configured to *not* fsync() on all Append() calls
I20260620 14:56:54.877758 23465 ts_tablet_manager.cc:1428] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:56:54.877880 23313 heartbeater.cc:503] Master 127.12.116.190:38917 was elected leader, sending a full tablet report...
I20260620 14:56:54.879658 23468 tablet_bootstrap.cc:492] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: No bootstrap required, opened a new log
I20260620 14:56:54.879786 23468 ts_tablet_manager.cc:1397] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260620 14:56:54.882174 23468 raft_consensus.cc:348] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:54.882448 23468 raft_consensus.cc:374] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:56:54.882498 23468 raft_consensus.cc:729] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66369ecaef9646b68a18ba0eaf4760c5, State: Initialized, Role: FOLLOWER
I20260620 14:56:54.882658 23468 consensus_queue.cc:260] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:54.883181 23468 ts_tablet_manager.cc:1428] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260620 14:56:54.883422 23179 heartbeater.cc:503] Master 127.12.116.190:38917 was elected leader, sending a full tablet report...
W20260620 14:56:54.901649 23180 tablet.cc:2369] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:56:55.074985 23448 tablet.cc:2369] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:56:55.118952 23314 tablet.cc:2369] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:56:55.248826 23470 raft_consensus.cc:482] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:56:55.248965 23470 raft_consensus.cc:504] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:55.249410 23470 leader_election.cc:288] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66369ecaef9646b68a18ba0eaf4760c5 (127.12.116.129:37105), b7150e6a693641f19c8eb5f20cdf1fd5 (127.12.116.131:40101)
I20260620 14:56:55.252724 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:55.249756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:46963 (local address 127.12.116.131:40101)
0620 14:56:55.249835 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:55.249837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:55.249915 (+ 78us) server_negotiation.cc:407] Connection header received
0620 14:56:55.250012 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:55.250013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:55.250023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:55.250076 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:55.250340 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.250823 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.251940 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.252310 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.252435 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:55.252444 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:55.252603 (+ 159us) server_negotiation.cc:299] Negotiation successful
0620 14:56:55.252641 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 14:56:55.252725 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:55.249763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:38717 (local address 127.12.116.129:37105)
0620 14:56:55.249869 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:55.249871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:55.250012 (+ 141us) server_negotiation.cc:407] Connection header received
0620 14:56:55.250046 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:55.250047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:55.250059 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:55.250120 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:56:55.250342 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.250823 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.251903 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.252292 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.252431 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:55.252442 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:55.252600 (+ 158us) server_negotiation.cc:299] Negotiation successful
0620 14:56:55.252641 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260620 14:56:55.252759 23473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:55.249671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37105 (local address 127.12.116.130:38717)
0620 14:56:55.249822 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:55.249837 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:55.249898 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:55.250149 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:55.250150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:55.250152 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:55.250253 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:55.250255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.250948 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.250949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:55.251783 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:55.251786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.252439 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.252440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:55.252516 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:55.252519 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:56:55.252593 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 14:56:55.252641 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":2,"thread_start_us":81,"threads_started":1}
I20260620 14:56:55.252784 23474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:55.249682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40101 (local address 127.12.116.130:46963)
0620 14:56:55.249851 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:55.249862 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:56:55.249939 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:56:55.250099 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:56:55.250100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:56:55.250103 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:56:55.250243 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:55.250246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.250928 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.250929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:55.251796 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:56:55.251799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.252436 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.252437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:56:55.252514 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:55.252518 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:56:55.252598 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 14:56:55.252648 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":90,"threads_started":1}
I20260620 14:56:55.253130 23133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310dde8a8c1b463091b3ca21169b2341" candidate_uuid: "be3a9bd49cdc462fa319a7695a562ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66369ecaef9646b68a18ba0eaf4760c5" is_pre_election: true
I20260620 14:56:55.253331 23133 raft_consensus.cc:2454] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3a9bd49cdc462fa319a7695a562ce2 in term 0.
I20260620 14:56:55.253417 23401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310dde8a8c1b463091b3ca21169b2341" candidate_uuid: "be3a9bd49cdc462fa319a7695a562ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" is_pre_election: true
I20260620 14:56:55.253579 23401 raft_consensus.cc:2454] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3a9bd49cdc462fa319a7695a562ce2 in term 0.
I20260620 14:56:55.253607 23201 leader_election.cc:302] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66369ecaef9646b68a18ba0eaf4760c5, be3a9bd49cdc462fa319a7695a562ce2; no voters:
I20260620 14:56:55.253777 23470 raft_consensus.cc:2781] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:56:55.253847 23470 raft_consensus.cc:482] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:56:55.253866 23470 raft_consensus.cc:3037] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:55.254856 23470 raft_consensus.cc:504] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:55.255136 23470 leader_election.cc:288] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [CANDIDATE]: Term 1 election: Requested vote from peers 66369ecaef9646b68a18ba0eaf4760c5 (127.12.116.129:37105), b7150e6a693641f19c8eb5f20cdf1fd5 (127.12.116.131:40101)
I20260620 14:56:55.255228 23133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310dde8a8c1b463091b3ca21169b2341" candidate_uuid: "be3a9bd49cdc462fa319a7695a562ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66369ecaef9646b68a18ba0eaf4760c5"
I20260620 14:56:55.255319 23133 raft_consensus.cc:3037] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:55.255400 23401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310dde8a8c1b463091b3ca21169b2341" candidate_uuid: "be3a9bd49cdc462fa319a7695a562ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5"
I20260620 14:56:55.255501 23401 raft_consensus.cc:3037] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:56:55.256151 23133 raft_consensus.cc:2454] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3a9bd49cdc462fa319a7695a562ce2 in term 1.
I20260620 14:56:55.256269 23401 raft_consensus.cc:2454] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3a9bd49cdc462fa319a7695a562ce2 in term 1.
I20260620 14:56:55.256369 23201 leader_election.cc:302] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66369ecaef9646b68a18ba0eaf4760c5, be3a9bd49cdc462fa319a7695a562ce2; no voters:
I20260620 14:56:55.256465 23470 raft_consensus.cc:2781] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:56:55.256629 23470 raft_consensus.cc:686] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 1 LEADER]: Becoming Leader. State: Replica: be3a9bd49cdc462fa319a7695a562ce2, State: Running, Role: LEADER
I20260620 14:56:55.256742 23470 consensus_queue.cc:237] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } }
I20260620 14:56:55.258181 22987 catalog_manager.cc:5495] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 reported cstate change: term changed from 0 to 1, leader changed from <none> to be3a9bd49cdc462fa319a7695a562ce2 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "be3a9bd49cdc462fa319a7695a562ce2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3a9bd49cdc462fa319a7695a562ce2" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35691 } health_report { overall_health: HEALTHY } } }
I20260620 14:56:55.312955 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:55.310031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54492 (local address 127.12.116.130:35691)
0620 14:56:55.310078 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 14:56:55.310080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:56:55.310092 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:56:55.310138 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:56:55.310139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:56:55.310156 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:56:55.310226 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:56:55.310441 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.310957 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.311971 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:56:55.312200 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:56:55.312274 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:56:55.312551 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:56:55.312673 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:56:55.312781 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0620 14:56:55.312856 (+ 75us) server_negotiation.cc:299] Negotiation successful
0620 14:56:55.312888 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:56:55.315166 23133 raft_consensus.cc:1261] T 310dde8a8c1b463091b3ca21169b2341 P 66369ecaef9646b68a18ba0eaf4760c5 [term 1 FOLLOWER]: Refusing update from remote peer be3a9bd49cdc462fa319a7695a562ce2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:55.315446 23401 raft_consensus.cc:1261] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 1 FOLLOWER]: Refusing update from remote peer be3a9bd49cdc462fa319a7695a562ce2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:56:55.315759 23470 consensus_queue.cc:1035] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66369ecaef9646b68a18ba0eaf4760c5" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:55.316110 23470 consensus_queue.cc:1035] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7150e6a693641f19c8eb5f20cdf1fd5" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:56:55.318746 23478 mvcc.cc:205] Tried to move back new op lower bound from 7298938533127188480 to 7298938532892463104. Current Snapshot: MvccSnapshot[applied={T|T < 7298938533127188480}]
I20260620 14:56:55.319011 23479 mvcc.cc:205] Tried to move back new op lower bound from 7298938533127188480 to 7298938532892463104. Current Snapshot: MvccSnapshot[applied={T|T < 7298938533127188480}]
I20260620 14:56:55.322418 22987 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:55.322626 22987 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:56:55.323822 22987 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f3997b9db184f509ed100bfd8ce0ddc: Sending DeleteTablet for 3 replicas of tablet 310dde8a8c1b463091b3ca21169b2341
I20260620 14:56:55.324306 23113 tablet_service.cc:1514] Processing DeleteTablet for tablet 310dde8a8c1b463091b3ca21169b2341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:55 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60168
I20260620 14:56:55.324411 23247 tablet_service.cc:1514] Processing DeleteTablet for tablet 310dde8a8c1b463091b3ca21169b2341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:55 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54478
I20260620 14:56:55.324420 23381 tablet_service.cc:1514] Processing DeleteTablet for tablet 310dde8a8c1b463091b3ca21169b2341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:56:55 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:46168
I20260620 14:56:55.324684 23490 tablet_replica.cc:330] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: stopping tablet replica
I20260620 14:56:55.324813 23490 raft_consensus.cc:2229] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:56:55.324931 23490 raft_consensus.cc:2258] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:55.325075 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 23050
I20260620 14:56:55.326328 23490 ts_tablet_manager.cc:1905] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:55.326833 23488 tablet_replica.cc:330] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: stopping tablet replica
I20260620 14:56:55.327030 23488 raft_consensus.cc:2229] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:56:55.327251 23488 raft_consensus.cc:2258] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:56:55.327725 23488 ts_tablet_manager.cc:1905] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:56:55.328646 23490 ts_tablet_manager.cc:1918] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:55.328742 23490 log.cc:1196] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/310dde8a8c1b463091b3ca21169b2341
I20260620 14:56:55.329038 23490 ts_tablet_manager.cc:1939] T 310dde8a8c1b463091b3ca21169b2341 P b7150e6a693641f19c8eb5f20cdf1fd5: Deleting consensus metadata
I20260620 14:56:55.329551 22972 catalog_manager.cc:4841] TS b7150e6a693641f19c8eb5f20cdf1fd5 (127.12.116.131:40101): tablet 310dde8a8c1b463091b3ca21169b2341 (table test-table [id=8345c08bed9a41539292c305bce7ec36]) successfully deleted
I20260620 14:56:55.329823 23488 ts_tablet_manager.cc:1918] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:56:55.329919 23488 log.cc:1196] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/310dde8a8c1b463091b3ca21169b2341
I20260620 14:56:55.330183 23488 ts_tablet_manager.cc:1939] T 310dde8a8c1b463091b3ca21169b2341 P be3a9bd49cdc462fa319a7695a562ce2: Deleting consensus metadata
I20260620 14:56:55.331208 22972 catalog_manager.cc:4841] TS be3a9bd49cdc462fa319a7695a562ce2 (127.12.116.130:35691): tablet 310dde8a8c1b463091b3ca21169b2341 (table test-table [id=8345c08bed9a41539292c305bce7ec36]) successfully deleted
W20260620 14:56:55.332403 22973 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:37105 (error 108)
I20260620 14:56:55.332960 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 23184
I20260620 14:56:55.333690 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:56:55.333031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37105 (local address 127.0.0.1:60184)
0620 14:56:55.333590 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0620 14:56:55.333660 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:37105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535}
W20260620 14:56:55.333855 22973 catalog_manager.cc:4584] TS 66369ecaef9646b68a18ba0eaf4760c5 (127.12.116.129:37105): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 310dde8a8c1b463091b3ca21169b2341: Network error: Client connection negotiation failed: client connection to 127.12.116.129:37105: connect: Connection refused (error 111)
I20260620 14:56:55.339294 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 23318
I20260620 14:56:55.346231 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 22956
2026-06-20T14:56:55Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2597 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:56:55 dist-test-slave-7v06 krb5kdc[23494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:56:55 dist-test-slave-7v06 krb5kdc[23494](info): set up 2 sockets
Jun 20 14:56:55 dist-test-slave-7v06 krb5kdc[23494](info): commencing operation
krb5kdc: starting...
W20260620 14:56:56.445631 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:56:56 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:56:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:56:56Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/rangeradmin_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/rangeradmin_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/rangerlookup_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/rangerlookup_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
I20260620 14:56:56.641140 12754 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskeVrfqy/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/postgres -l logfile start
2026-06-20 14:57:00.123 UTC [23524] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-20 14:57:00.123 UTC [23524] LOG: listening on IPv4 address "127.12.116.148", port 51035
2026-06-20 14:57:00.128 UTC [23524] LOG: listening on Unix socket "/tmp/.s.PGSQL.51035"
2026-06-20 14:57:00.154 UTC [23527] LOG: database system was shut down at 2026-06-20 14:56:57 UTC
2026-06-20 14:57:00.161 UTC [23524] LOG: database system is ready to accept connections
I20260620 14:57:01.217517 12754 mini_postgres.cc:96] Postgres bound to 51035
2026-06-20 14:57:01.225 UTC [23535] FATAL: database "slave" does not exist
127.12.116.148:51035 - accepting connections
I20260620 14:57:01.225927 12754 mini_ranger.cc:161] Starting Ranger...
I20260620 14:57:01.244107 12754 mini_ranger.cc:84] Created miniranger Postgres user
I20260620 14:57:01.998921 12754 mini_ranger.cc:87] Created ranger Postgres database
I20260620 14:57:01.999027 12754 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-admin
2026-06-20 14:57:02,337 [I] DB FLAVOR :POSTGRES
2026-06-20 14:57:02,338 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 14:57:02,338 [I] Checking connection..
2026-06-20 14:57:02,338 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-20 14:57:02,675 [I] Checking connection passed.
2026-06-20 14:57:02,676 [I] --------- Verifying version history table ---------
2026-06-20 14:57:02,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 14:57:03,019 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 14:57:03,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 14:57:03,324 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 14:57:03,325 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-20 14:57:03,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-20 14:57:03.631 UTC [23599] WARNING: there is no transaction in progress
2026-06-20 14:57:03,638 [I] create_dbversion_catalog.sql file imported successfully
2026-06-20 14:57:03,639 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 14:57:03,951 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-20 14:57:03,951 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 14:57:03,951 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-20 14:57:04,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-20 14:57:04,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7v06.c.gcp-upstream.internal','N') ;"
2026-06-20 14:57:04,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 14:57:05,197 [I] Table x_portal_user does not exist in database ranger
2026-06-20 14:57:05,197 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 14:57:05,513 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-20 14:57:05,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 14:57:05,805 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 14:57:06,109 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-20 14:57:06,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-20 14:57:07.410 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.435 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.461 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.485 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.509 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.536 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.610 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.620 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.640 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.653 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.667 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.687 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.700 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.709 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.718 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:07.728 UTC [23707] WARNING: there is no transaction in progress
2026-06-20 14:57:08,855 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-20 14:57:08,855 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-20 14:57:09,172 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-20 14:57:09,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 14:57:09,491 [I] Table x_portal_user already exists in database 'ranger'
2026-06-20 14:57:09,492 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 14:57:09,812 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-20 14:57:09,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 14:57:10,131 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 14:57:10,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7v06.c.gcp-upstream.internal';"
2026-06-20 14:57:10,700 [I] CORE_DB_SCHEMA import status has been updated
2026-06-20 14:57:10,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-20 14:57:10,998 [I] DB_PATCHES have already been applied
I20260620 14:57:11.005195 12754 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-admin:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskeVrfqy/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260620 14:57:11.005314 12754 mini_ranger.cc:193] Using host: 127.12.116.148
I20260620 14:57:11.010293 12754 mini_ranger.cc:227] Ranger admin URL: http://127.12.116.148:49477
Jun 20, 2026 2:57:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 2:57:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 2:57:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp
Jun 20, 2026 2:57:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 20, 2026 2:57:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 20, 2026 2:57:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp].
Jun 20, 2026 2:57:12 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260620 14:57:12.264146 12754 mini_ranger.cc:160] Time spent starting Ranger: real 11.038s user 0.000s sys 0.012s
Jun 20, 2026 2:57:36 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 20, 2026 2:57:36 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 20, 2026 2:57:36 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 20, 2026 2:57:36 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 20, 2026 2:57:38 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260620 14:57:38.779920 12754 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/rangerkms_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/rangerkms_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.116.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.116.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 20 14:57:38 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967458, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260620 14:57:38.876196 12754 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260620 14:57:38.888813 12754 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260620 14:57:40.208011 12754 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260620 14:57:40.208115 12754 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms
I20260620 14:57:40.208138 12754 mini_ranger_kms.cc:227] Using postgres at 127.12.116.148:51035
2026-06-20 14:57:40,445 [I] DB FLAVOR :POSTGRES
2026-06-20 14:57:40,445 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 14:57:40,445 [I] Checking connection
2026-06-20 14:57:40,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-20 14:57:40,769 [I] connection success
2026-06-20 14:57:40,769 [I] --------- Verifying Ranger DB tables ---------
2026-06-20 14:57:40,769 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-20 14:57:40,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-20 14:57:41,071 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-20 14:57:41,072 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 14:57:41,072 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-20 14:57:41,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:51035/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-20 14:57:41,412 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260620 14:57:42.121122 12754 mini_ranger_kms.cc:310] Created kms service
I20260620 14:57:42.373230 12754 mini_ranger_kms.cc:326] Created kudu user
I20260620 14:57:42.435313 12754 mini_ranger_kms.cc:343] Created rangerkms user
Jun 20 14:57:42 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967458, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:57:42.981117 12754 mini_ranger_kms.cc:384] Added ranger policy
I20260620 14:57:42.981278 12754 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms:/tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260620 14:57:42.981310 12754 mini_ranger_kms.cc:240] Using host: 127.12.116.148
I20260620 14:57:42.985517 12754 mini_ranger_kms.cc:276] Ranger KMS PID: 23888
I20260620 14:57:42.985695 12754 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.116.148:35841
Jun 20, 2026 2:57:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 2:57:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 2:57:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 20, 2026 2:57:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 20, 2026 2:57:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-kms/ews/webapp].
Jun 20, 2026 2:57:44 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260620 14:57:45.389225 12754 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.513s user 0.010s sys 0.204s
I20260620 14:57:45.389384 12754 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260620 14:57:45.389709 12754 mini_ranger_kms.cc:401] 127.12.116.148:35841/kms/v1/keys
Jun 20 14:57:45 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781967465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.116.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 20 14:57:46 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.116.148@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
Jun 20 14:57:46 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.116.148@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
Jun 20 14:57:49 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:57:49.373641 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43493
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43493
--ranger_config_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:35841/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:57:49.485656 23938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:57:49.485942 23938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:57:49.485970 23938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:57:49.487486 23938 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:57:49.487567 23938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:57:49.487584 23938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:57:49.487598 23938 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:57:49.487612 23938 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:57:49.490195 23938 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.116.148:35841/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43493
--ranger_config_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:57:49.491097 23938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:57:49.491503 23938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:57:49.497800 23944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:49.497861 23943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:49.497861 23946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:57:49.498304 23938 server_base.cc:1034] running on GCE node
I20260620 14:57:49.498915 23938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:57:49.499475 23938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:57:49.500752 23938 hybrid_clock.cc:648] HybridClock initialized: now 1781967469500720 us; error 75 us; skew 500 ppm
Jun 20 14:57:49 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967469, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:57:49.507676 23938 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:57:49.508258 23938 webserver.cc:460] Webserver started at http://127.12.116.190:46093/ using document root <none> and password file <none>
I20260620 14:57:49.508559 23938 fs_manager.cc:359] Metadata directory not provided
I20260620 14:57:49.508628 23938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:57:49.508795 23938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:57:49 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967469, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:57:49.576969 23938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "c3a491487f7947588c7320d3568e182d"
format_stamp: "Formatted at 2026-06-20 14:57:49 on dist-test-slave-7v06"
server_key: "03d585f54615381bd13a13ac684b1887"
server_key_iv: "64bf3ef7ac68cba2f22c6741792bed3c"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:49.577533 23938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "c3a491487f7947588c7320d3568e182d"
format_stamp: "Formatted at 2026-06-20 14:57:49 on dist-test-slave-7v06"
server_key: "03d585f54615381bd13a13ac684b1887"
server_key_iv: "64bf3ef7ac68cba2f22c6741792bed3c"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:49.579670 23938 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:57:49.601147 23953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:49.601493 23938 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260620 14:57:49.601635 23938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "c3a491487f7947588c7320d3568e182d"
format_stamp: "Formatted at 2026-06-20 14:57:49 on dist-test-slave-7v06"
server_key: "03d585f54615381bd13a13ac684b1887"
server_key_iv: "64bf3ef7ac68cba2f22c6741792bed3c"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:49.601759 23938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:57:49.622279 23938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:57:49.625406 23938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:57:49.625609 23938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:57:49.633123 23938 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43493
I20260620 14:57:49.633468 24005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43493 every 8 connection(s)
I20260620 14:57:49.633895 23938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:57:49.634886 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:57:49.639504 24006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d: Bootstrap starting.
I20260620 14:57:49.640316 24006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d: Neither blocks nor log segments found. Creating new log.
I20260620 14:57:49.640714 24006 log.cc:824] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:57:49.641649 24006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d: No bootstrap required, opened a new log
I20260620 14:57:49.644098 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 23938
I20260620 14:57:49.644234 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:57:49.644491 12754 external_mini_cluster.cc:1428] Setting key 29ffafdf6c3f1231fb103986426132ad
I20260620 14:57:49.644268 24006 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a491487f7947588c7320d3568e182d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43493 } }
I20260620 14:57:49.644543 24006 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:57:49.644582 24006 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a491487f7947588c7320d3568e182d, State: Initialized, Role: FOLLOWER
I20260620 14:57:49.644789 24006 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a491487f7947588c7320d3568e182d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43493 } }
I20260620 14:57:49.644910 24006 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:57:49.644959 24006 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:57:49.645015 24006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:57:49.645977 24006 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a491487f7947588c7320d3568e182d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43493 } }
I20260620 14:57:49.646109 24006 leader_election.cc:302] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3a491487f7947588c7320d3568e182d; no voters:
I20260620 14:57:49.646258 24006 leader_election.cc:288] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:57:49.646555 24006 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:57:49.647153 24011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:57:49.647891 24011 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [term 1 LEADER]: Becoming Leader. State: Replica: c3a491487f7947588c7320d3568e182d, State: Running, Role: LEADER
I20260620 14:57:49.648105 24011 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a491487f7947588c7320d3568e182d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43493 } }
I20260620 14:57:49.648681 24011 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3a491487f7947588c7320d3568e182d. Latest consensus state: current_term: 1 leader_uuid: "c3a491487f7947588c7320d3568e182d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a491487f7947588c7320d3568e182d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43493 } } }
I20260620 14:57:49.648785 24011 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [sys.catalog]: This master's current role is: LEADER
I20260620 14:57:49.649237 24012 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3a491487f7947588c7320d3568e182d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a491487f7947588c7320d3568e182d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43493 } } }
I20260620 14:57:49.649367 24006 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260620 14:57:49.649389 24012 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d [sys.catalog]: This master's current role is: LEADER
I20260620 14:57:49.650230 24025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:57:49.650813 24025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:57:49.652915 24025 catalog_manager.cc:1347] Generated new cluster ID: 9130b522b9ab4641b753e9ae9d65a9c1
I20260620 14:57:49.653048 24025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 14:57:49 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:57:49.664600 24010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:49.645297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42436 (local address 127.12.116.190:43493)
0620 14:57:49.645618 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:49.645631 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:49.645675 (+ 44us) server_negotiation.cc:407] Connection header received
0620 14:57:49.645899 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:49.645908 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:49.645979 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:49.646149 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:57:49.647180 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:49.649153 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:49.650433 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:49.651062 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:49.651189 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:49.654695 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:57:49.654701 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:57:49.654702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:57:49.654717 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:57:49.661985 (+ 7268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:49.662662 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:49.662667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:49.662668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:49.662839 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:49.663123 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:49.663123 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:49.663124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:49.663591 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:57:49.663835 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:49.663933 (+ 98us) server_negotiation.cc:299] Negotiation successful
0620 14:57:49.664286 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":123,"threads_started":1}
I20260620 14:57:49.683017 24025 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:57:49.684528 24025 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:57:49.689858 24025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d: Generated new TSK 0
I20260620 14:57:49.690253 24025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:57:50.565531 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:35841/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43493
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:57:50.695765 24051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:57:50.695997 24051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:57:50.696025 24051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:57:50.697640 24051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:57:50.697718 24051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:57:50.697752 24051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:57:50.699858 24051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.116.148:35841/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:57:50.700197 24051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:57:50.700527 24051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:57:50.707505 24057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:50.707537 24056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:50.707537 24059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:57:50.708621 24051 server_base.cc:1034] running on GCE node
I20260620 14:57:50.708941 24051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:57:50.709779 24051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:57:50.713246 24051 hybrid_clock.cc:648] HybridClock initialized: now 1781967470713213 us; error 70 us; skew 500 ppm
Jun 20 14:57:50 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967470, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:57:50.716531 24051 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:57:50.717212 24051 webserver.cc:460] Webserver started at http://127.12.116.129:41939/ using document root <none> and password file <none>
I20260620 14:57:50.717514 24051 fs_manager.cc:359] Metadata directory not provided
I20260620 14:57:50.717588 24051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:57:50.717746 24051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:57:50 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967470, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:57:50.735525 24051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "2f200217b58a46e688cc6b874e47f821"
format_stamp: "Formatted at 2026-06-20 14:57:50 on dist-test-slave-7v06"
server_key: "599c18ab4b099ee8e77952b5cfb5b9bb"
server_key_iv: "4fb3be8656e5a3176a2cbdd10cce693b"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:50.736088 24051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "2f200217b58a46e688cc6b874e47f821"
format_stamp: "Formatted at 2026-06-20 14:57:50 on dist-test-slave-7v06"
server_key: "599c18ab4b099ee8e77952b5cfb5b9bb"
server_key_iv: "4fb3be8656e5a3176a2cbdd10cce693b"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:50.739444 24051 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260620 14:57:50.760578 24066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:50.760861 24051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:57:50.760964 24051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "2f200217b58a46e688cc6b874e47f821"
format_stamp: "Formatted at 2026-06-20 14:57:50 on dist-test-slave-7v06"
server_key: "599c18ab4b099ee8e77952b5cfb5b9bb"
server_key_iv: "4fb3be8656e5a3176a2cbdd10cce693b"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:50.761103 24051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:57:50.783414 24051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:57:50.786442 24051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:57:50.786617 24051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:57:50.786890 24051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:57:50.787285 24051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:57:50.787326 24051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:50.787357 24051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:57:50.787376 24051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:50.794646 24051 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:43559
I20260620 14:57:50.795152 24051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:57:50.801714 24181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:43559 every 8 connection(s)
I20260620 14:57:50.803784 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 24051
I20260620 14:57:50.803941 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:57:50.804158 12754 external_mini_cluster.cc:1428] Setting key 73b632816123b4c2cd53789fe59f9391
Jun 20 14:57:50 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967470, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:57:50.818145 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:50.802754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43493 (local address 127.12.116.129:58241)
0620 14:57:50.803015 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:50.803077 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:50.803831 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:50.804733 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:50.804739 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:50.805065 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:57:50.805452 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:50.805461 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:50.806729 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:50.806730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:50.808561 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:50.808567 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:50.809249 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:50.809251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:50.809456 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:50.810255 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:57:50.810286 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:57:50.812262 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:57:50.815443 (+ 3181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:57:50.815460 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:57:50.815464 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:57:50.816002 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:57:50.816402 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:57:50.816405 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:57:50.816406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:57:50.816738 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:57:50.817233 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:57:50.817242 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:57:50.817471 (+ 229us) client_negotiation.cc:769] Sending connection context
0620 14:57:50.817594 (+ 123us) client_negotiation.cc:240] Negotiation successful
0620 14:57:50.817855 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":117,"threads_started":1}
I20260620 14:57:50.818586 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:50.802802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:58241 (local address 127.12.116.190:43493)
0620 14:57:50.804079 (+ 1277us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:50.804082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:50.804093 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:57:50.804125 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:50.804126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:50.804142 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:50.804219 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:57:50.805605 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:50.806570 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:50.808707 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:50.809065 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:50.809146 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:50.812480 (+ 3334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:57:50.812482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:57:50.812483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:57:50.812494 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:57:50.815257 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:50.816119 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:50.816120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:50.816121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:50.816199 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:50.816848 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:50.816849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:50.816849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:50.817126 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:57:50.817199 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:50.818377 (+ 1178us) server_negotiation.cc:299] Negotiation successful
0620 14:57:50.818487 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1247,"thread_start_us":93,"threads_started":1}
I20260620 14:57:50.819200 24182 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43493
I20260620 14:57:50.819322 24182 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:57:50.819583 24182 heartbeater.cc:511] Master 127.12.116.190:43493 requested a full tablet report, sending...
I20260620 14:57:50.820272 23970 ts_manager.cc:194] Registered new tserver with Master: 2f200217b58a46e688cc6b874e47f821 (127.12.116.129:43559)
I20260620 14:57:50.821162 23970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:58241
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:57:50.845906 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:35841/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43493
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:57:50.975988 24188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:57:50.976658 24188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:57:50.976747 24188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:57:50.980479 24188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:57:50.980602 24188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:57:50.980665 24188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:57:50.984054 24188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.116.148:35841/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:57:50.984460 24188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:57:50.984763 24188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:57:50.991797 24198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:50.991780 24196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:50.991780 24195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:57:50.992899 24188 server_base.cc:1034] running on GCE node
I20260620 14:57:50.993386 24188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:57:50.993847 24188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:57:50.995235 24188 hybrid_clock.cc:648] HybridClock initialized: now 1781967470995105 us; error 69 us; skew 500 ppm
Jun 20 14:57:50 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967470, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:57:51.000895 24188 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:57:51.001813 24188 webserver.cc:460] Webserver started at http://127.12.116.130:46745/ using document root <none> and password file <none>
I20260620 14:57:51.002203 24188 fs_manager.cc:359] Metadata directory not provided
I20260620 14:57:51.002269 24188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:57:51.002456 24188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967470, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781967471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:57:51.017535 24188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8"
format_stamp: "Formatted at 2026-06-20 14:57:51 on dist-test-slave-7v06"
server_key: "0ddde579b76dc3d2d6cea3db19a1fbf7"
server_key_iv: "bea7cc9d1762754010922b4964a29dfa"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:51.018038 24188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8"
format_stamp: "Formatted at 2026-06-20 14:57:51 on dist-test-slave-7v06"
server_key: "0ddde579b76dc3d2d6cea3db19a1fbf7"
server_key_iv: "bea7cc9d1762754010922b4964a29dfa"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:51.020445 24188 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260620 14:57:51.045234 24205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:51.045660 24188 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.002s sys 0.000s
I20260620 14:57:51.045866 24188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8"
format_stamp: "Formatted at 2026-06-20 14:57:51 on dist-test-slave-7v06"
server_key: "0ddde579b76dc3d2d6cea3db19a1fbf7"
server_key_iv: "bea7cc9d1762754010922b4964a29dfa"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:51.046053 24188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:57:51.057159 24188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:57:51.060307 24188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:57:51.060559 24188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:57:51.060945 24188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:57:51.061365 24188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:57:51.061420 24188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:51.061461 24188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:57:51.061493 24188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:51.069948 24188 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:38939
I20260620 14:57:51.070152 24318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:38939 every 8 connection(s)
I20260620 14:57:51.070420 24188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:57:51.074795 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 24188
I20260620 14:57:51.074927 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:57:51.075107 12754 external_mini_cluster.cc:1428] Setting key 27f7cf539d47e9f8fce489f1338bd1dd
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967470, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:57:51.083738 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.071618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:56157 (local address 127.12.116.190:43493)
0620 14:57:51.071707 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.071709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.071721 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:57:51.072367 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.072369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.072385 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.072444 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:57:51.073996 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.074546 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.076139 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.076517 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.076602 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.079541 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:57:51.079542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:57:51.079543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:57:51.079552 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:57:51.081848 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:51.082570 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:51.082571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:51.082572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:51.082629 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:51.082990 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:51.082991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:51.082991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:51.083140 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:57:51.083214 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.083530 (+ 316us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.083636 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260620 14:57:51.083993 24321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.071336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43493 (local address 127.12.116.130:56157)
0620 14:57:51.071554 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.071598 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.072181 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.072678 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.072927 (+ 249us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.073178 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:57:51.073842 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.073852 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.074714 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.074716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.076037 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.076041 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.076636 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.076637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.076821 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.077513 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:57:51.077525 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:57:51.079412 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:57:51.082014 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:57:51.082031 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:57:51.082034 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:57:51.082449 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:57:51.082726 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:57:51.082727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:57:51.082727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:57:51.082870 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:57:51.083217 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:57:51.083226 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:57:51.083391 (+ 165us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.083512 (+ 121us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.083688 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":109,"threads_started":1}
I20260620 14:57:51.084833 24319 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43493
I20260620 14:57:51.084975 24319 heartbeater.cc:464] Registering TS with master...
I20260620 14:57:51.085189 24319 heartbeater.cc:511] Master 127.12.116.190:43493 requested a full tablet report, sending...
I20260620 14:57:51.085701 23970 ts_manager.cc:194] Registered new tserver with Master: 5978d9bf43fe48e9806ba96b9f5dd8d8 (127.12.116.130:38939)
I20260620 14:57:51.086226 23970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:56157
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:57:51.112378 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:35841/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43493
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:57:51.225890 24325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:57:51.226298 24325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:57:51.226393 24325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:57:51.228498 24325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:57:51.228657 24325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:57:51.228749 24325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:57:51.230823 24325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.116.148:35841/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:57:51.231153 24325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:57:51.231438 24325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:57:51.236753 24333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:51.236764 24331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:57:51.237215 24330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:57:51.237649 24325 server_base.cc:1034] running on GCE node
I20260620 14:57:51.237879 24325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:57:51.238129 24325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:57:51.239333 24325 hybrid_clock.cc:648] HybridClock initialized: now 1781967471239310 us; error 39 us; skew 500 ppm
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:57:51.242117 24325 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:57:51.242826 24325 webserver.cc:460] Webserver started at http://127.12.116.131:34597/ using document root <none> and password file <none>
I20260620 14:57:51.243109 24325 fs_manager.cc:359] Metadata directory not provided
I20260620 14:57:51.243187 24325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:57:51.243338 24325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:57:51.259662 24325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "aa1fd9b2195048f7ab71a83843bc4fd1"
format_stamp: "Formatted at 2026-06-20 14:57:51 on dist-test-slave-7v06"
server_key: "6803e4c88b5a51a4f9d97a9e2a46ccd4"
server_key_iv: "1f430ed157a147f620d67bff3a828b9b"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:51.260584 24325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "aa1fd9b2195048f7ab71a83843bc4fd1"
format_stamp: "Formatted at 2026-06-20 14:57:51 on dist-test-slave-7v06"
server_key: "6803e4c88b5a51a4f9d97a9e2a46ccd4"
server_key_iv: "1f430ed157a147f620d67bff3a828b9b"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:51.262687 24325 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260620 14:57:51.278555 24340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:51.278853 24325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260620 14:57:51.278999 24325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "aa1fd9b2195048f7ab71a83843bc4fd1"
format_stamp: "Formatted at 2026-06-20 14:57:51 on dist-test-slave-7v06"
server_key: "6803e4c88b5a51a4f9d97a9e2a46ccd4"
server_key_iv: "1f430ed157a147f620d67bff3a828b9b"
server_key_version: "kuduclusterkey@0"
I20260620 14:57:51.279212 24325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:57:51.302770 24325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:57:51.312680 24325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:57:51.312879 24325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:57:51.313165 24325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:57:51.313634 24325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:57:51.313704 24325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:51.313747 24325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:57:51.313771 24325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:57:51.322258 24325 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:41331
I20260620 14:57:51.322687 24325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:57:51.323523 24453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:41331 every 8 connection(s)
I20260620 14:57:51.329607 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 24325
I20260620 14:57:51.329721 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:57:51.329953 12754 external_mini_cluster.cc:1428] Setting key 4229cee2a1707b8ed3f350b4006ce6fe
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:57:51.335553 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.323829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:44043 (local address 127.12.116.190:43493)
0620 14:57:51.323884 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.323887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.324076 (+ 189us) server_negotiation.cc:407] Connection header received
0620 14:57:51.324846 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.324847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.324859 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.324924 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:57:51.325539 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.326058 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.327117 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.327326 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.327405 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.330996 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:57:51.330997 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:57:51.330998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:57:51.331006 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:57:51.333464 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:51.334251 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:51.334253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:51.334254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:51.334333 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:51.334684 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:51.334686 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:51.334686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:51.334860 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:57:51.334946 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.335321 (+ 375us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.335432 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:57:51.336004 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.323523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43493 (local address 127.12.116.131:44043)
0620 14:57:51.323935 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.323983 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.324727 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.324988 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.324992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.325213 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:57:51.325427 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.325432 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.326157 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.326158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.327005 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.327007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.327423 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.327424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.327567 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.328399 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:57:51.328409 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:57:51.330878 (+ 2469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:57:51.333645 (+ 2767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:57:51.333677 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:57:51.333682 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:57:51.334130 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:57:51.334414 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:57:51.334414 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:57:51.334415 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:57:51.334608 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:57:51.334934 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:57:51.334942 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:57:51.335147 (+ 205us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.335299 (+ 152us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.335522 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":74,"threads_started":1}
I20260620 14:57:51.337157 24454 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43493
I20260620 14:57:51.337309 24454 heartbeater.cc:464] Registering TS with master...
I20260620 14:57:51.337554 24454 heartbeater.cc:511] Master 127.12.116.190:43493 requested a full tablet report, sending...
I20260620 14:57:51.338152 23970 ts_manager.cc:194] Registered new tserver with Master: aa1fd9b2195048f7ab71a83843bc4fd1 (127.12.116.131:41331)
I20260620 14:57:51.338608 23970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:44043
I20260620 14:57:51.341956 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:57:51.352788 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.344480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41838 (local address 127.12.116.190:43493)
0620 14:57:51.344531 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.344536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.345493 (+ 957us) server_negotiation.cc:407] Connection header received
0620 14:57:51.345608 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.345609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.345623 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.345658 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:57:51.346644 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.347219 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.348122 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.348312 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.348468 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.349873 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:57:51.349874 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:57:51.349875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:57:51.349882 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:57:51.351501 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:51.351926 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:51.351927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:51.351928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:51.352001 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:57:51.352204 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:57:51.352205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:57:51.352206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:57:51.352319 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:57:51.352455 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.352633 (+ 178us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.352705 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 14:57:51.354665 23970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:57:51.357663 23970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:57:51.366473 24467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.361205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43559 (local address 127.0.0.1:57648)
0620 14:57:51.361922 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.361933 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.362016 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.362361 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.362362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.362364 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:57:51.362398 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.362399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.363717 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.363718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.364900 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.364903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.366078 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.366079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.366165 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.366180 (+ 15us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.366260 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.366366 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":93,"threads_started":1}
I20260620 14:57:51.366770 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.361490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57648 (local address 127.12.116.129:43559)
0620 14:57:51.362219 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.362222 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.362231 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:57:51.362256 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.362258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.362272 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.362363 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:57:51.362481 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.363580 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.365008 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.365901 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.365979 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.366040 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.366647 (+ 607us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.366700 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":60,"threads_started":1}
I20260620 14:57:51.366822 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.361452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:38939 (local address 127.0.0.1:36432)
0620 14:57:51.362453 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.362463 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.362505 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.362800 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.362801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.362803 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:57:51.362842 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.362843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.364189 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.364190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.365326 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.365329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.366309 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.366310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.366362 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.366366 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.366396 (+ 30us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.366431 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":79,"threads_started":1}
I20260620 14:57:51.367069 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.361184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:41331 (local address 127.0.0.1:58614)
0620 14:57:51.361558 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.361606 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.361716 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.362056 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.362059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.362061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:57:51.362121 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.362123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.363399 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.363401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.365178 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.365181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.366841 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.366843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.366903 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.366906 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.366950 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.366992 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
I20260620 14:57:51.367321 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.361679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36432 (local address 127.12.116.130:38939)
0620 14:57:51.362624 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.362628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.362637 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:57:51.362673 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.362675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.362689 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.362909 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:57:51.362961 (+ 52us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.364031 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.365472 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.366217 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.367056 (+ 839us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.367153 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.367185 (+ 32us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.367238 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":911,"thread_start_us":86,"threads_started":1}
I20260620 14:57:51.367698 24468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.361284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58614 (local address 127.12.116.131:41331)
0620 14:57:51.361485 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.361491 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.361673 (+ 182us) server_negotiation.cc:407] Connection header received
0620 14:57:51.361854 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.361857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.361875 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.361930 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:57:51.362198 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.363276 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.365834 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.366754 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.367476 (+ 722us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.367544 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.367574 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.367621 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":73,"threads_started":1}
I20260620 14:57:51.367858 24115 tablet_service.cc:1467] Processing CreateTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 (DEFAULT_TABLE table=test-table [id=76c879d26a84488eae0d57262ecb90f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:57:51.367868 24253 tablet_service.cc:1467] Processing CreateTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 (DEFAULT_TABLE table=test-table [id=76c879d26a84488eae0d57262ecb90f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:57:51.368225 24115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac26f7cfe5334ac780b9504a3ba5b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:57:51.368225 24253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac26f7cfe5334ac780b9504a3ba5b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:57:51.372011 24472 tablet_bootstrap.cc:492] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Bootstrap starting.
I20260620 14:57:51.372225 24473 tablet_bootstrap.cc:492] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: Bootstrap starting.
I20260620 14:57:51.372553 24388 tablet_service.cc:1467] Processing CreateTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 (DEFAULT_TABLE table=test-table [id=76c879d26a84488eae0d57262ecb90f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:57:51.372959 24388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac26f7cfe5334ac780b9504a3ba5b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:57:51.373211 24473 tablet_bootstrap.cc:654] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: Neither blocks nor log segments found. Creating new log.
I20260620 14:57:51.373579 24473 log.cc:824] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: Log is configured to *not* fsync() on all Append() calls
I20260620 14:57:51.373718 24472 tablet_bootstrap.cc:654] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Neither blocks nor log segments found. Creating new log.
I20260620 14:57:51.374054 24472 log.cc:824] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Log is configured to *not* fsync() on all Append() calls
I20260620 14:57:51.374604 24473 tablet_bootstrap.cc:492] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: No bootstrap required, opened a new log
I20260620 14:57:51.374675 24473 ts_tablet_manager.cc:1397] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:57:51.376821 24476 tablet_bootstrap.cc:492] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Bootstrap starting.
I20260620 14:57:51.377449 24473 raft_consensus.cc:348] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.377660 24472 tablet_bootstrap.cc:492] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: No bootstrap required, opened a new log
I20260620 14:57:51.377740 24472 ts_tablet_manager.cc:1397] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260620 14:57:51.377828 24473 raft_consensus.cc:374] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:57:51.377921 24473 raft_consensus.cc:729] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f200217b58a46e688cc6b874e47f821, State: Initialized, Role: FOLLOWER
I20260620 14:57:51.378002 24476 tablet_bootstrap.cc:654] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Neither blocks nor log segments found. Creating new log.
I20260620 14:57:51.378196 24473 consensus_queue.cc:260] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.378319 24476 log.cc:824] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Log is configured to *not* fsync() on all Append() calls
I20260620 14:57:51.378604 24473 ts_tablet_manager.cc:1428] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 14:57:51.378785 24182 heartbeater.cc:503] Master 127.12.116.190:43493 was elected leader, sending a full tablet report...
I20260620 14:57:51.379168 24476 tablet_bootstrap.cc:492] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: No bootstrap required, opened a new log
I20260620 14:57:51.379257 24476 ts_tablet_manager.cc:1397] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:57:51.380400 24472 raft_consensus.cc:348] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.380666 24472 raft_consensus.cc:374] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:57:51.380709 24472 raft_consensus.cc:729] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5978d9bf43fe48e9806ba96b9f5dd8d8, State: Initialized, Role: FOLLOWER
I20260620 14:57:51.380880 24472 consensus_queue.cc:260] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.381232 24472 ts_tablet_manager.cc:1428] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260620 14:57:51.381413 24319 heartbeater.cc:503] Master 127.12.116.190:43493 was elected leader, sending a full tablet report...
I20260620 14:57:51.381629 24476 raft_consensus.cc:348] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.381824 24476 raft_consensus.cc:374] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:57:51.381873 24476 raft_consensus.cc:729] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa1fd9b2195048f7ab71a83843bc4fd1, State: Initialized, Role: FOLLOWER
I20260620 14:57:51.381989 24476 consensus_queue.cc:260] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.382283 24476 ts_tablet_manager.cc:1428] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:57:51.382381 24454 heartbeater.cc:503] Master 127.12.116.190:43493 was elected leader, sending a full tablet report...
W20260620 14:57:51.553094 24183 tablet.cc:2369] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 20 14:57:51 dist-test-slave-7v06 krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
W20260620 14:57:51.571281 24320 tablet.cc:2369] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:57:51.573719 24455 tablet.cc:2369] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:57:51.655040 24478 raft_consensus.cc:482] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:57:51.655217 24478 raft_consensus.cc:504] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.655774 24478 leader_election.cc:288] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa1fd9b2195048f7ab71a83843bc4fd1 (127.12.116.131:41331), 5978d9bf43fe48e9806ba96b9f5dd8d8 (127.12.116.130:38939)
I20260620 14:57:51.660660 24468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.656372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:36031 (local address 127.12.116.131:41331)
0620 14:57:51.656442 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.656445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.656645 (+ 200us) server_negotiation.cc:407] Connection header received
0620 14:57:51.656730 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.656731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.656741 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.656814 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:57:51.657026 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.657737 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.659517 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.660153 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.660218 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.660228 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.660522 (+ 294us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.660574 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 14:57:51.661002 24481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.656147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:41331 (local address 127.12.116.129:36031)
0620 14:57:51.656579 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.656591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.656661 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.656816 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.656817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.656831 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:57:51.656930 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.656933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.657878 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.657879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.659269 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.659274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.660304 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.660305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.660427 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.660432 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.660850 (+ 418us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.660911 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":117,"threads_started":1}
I20260620 14:57:51.661489 24391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac26f7cfe5334ac780b9504a3ba5b2c1" candidate_uuid: "2f200217b58a46e688cc6b874e47f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" is_pre_election: true
I20260620 14:57:51.661681 24391 raft_consensus.cc:2454] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f200217b58a46e688cc6b874e47f821 in term 0.
I20260620 14:57:51.662034 24068 leader_election.cc:302] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f200217b58a46e688cc6b874e47f821, aa1fd9b2195048f7ab71a83843bc4fd1; no voters:
I20260620 14:57:51.662189 24478 raft_consensus.cc:2781] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:57:51.662241 24478 raft_consensus.cc:482] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:57:51.662268 24478 raft_consensus.cc:3037] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:57:51.663226 24478 raft_consensus.cc:504] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.663383 24478 leader_election.cc:288] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [CANDIDATE]: Term 1 election: Requested vote from peers aa1fd9b2195048f7ab71a83843bc4fd1 (127.12.116.131:41331), 5978d9bf43fe48e9806ba96b9f5dd8d8 (127.12.116.130:38939)
I20260620 14:57:51.663637 24391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac26f7cfe5334ac780b9504a3ba5b2c1" candidate_uuid: "2f200217b58a46e688cc6b874e47f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1"
I20260620 14:57:51.663733 24391 raft_consensus.cc:3037] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:57:51.664743 24391 raft_consensus.cc:2454] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f200217b58a46e688cc6b874e47f821 in term 1.
I20260620 14:57:51.664966 24068 leader_election.cc:302] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f200217b58a46e688cc6b874e47f821, aa1fd9b2195048f7ab71a83843bc4fd1; no voters:
I20260620 14:57:51.665071 24478 raft_consensus.cc:2781] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:57:51.665239 24478 raft_consensus.cc:686] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [term 1 LEADER]: Becoming Leader. State: Replica: 2f200217b58a46e688cc6b874e47f821, State: Running, Role: LEADER
I20260620 14:57:51.665361 24478 consensus_queue.cc:237] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } }
I20260620 14:57:51.666253 23970 catalog_manager.cc:5495] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f200217b58a46e688cc6b874e47f821 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "2f200217b58a46e688cc6b874e47f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f200217b58a46e688cc6b874e47f821" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 } health_report { overall_health: UNKNOWN } } }
I20260620 14:57:51.670229 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.656492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:56061 (local address 127.12.116.130:38939)
0620 14:57:51.656539 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.656541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.666831 (+ 10290us) server_negotiation.cc:407] Connection header received
0620 14:57:51.666946 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.666948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.666958 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.666990 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:57:51.667509 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.668232 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.669444 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.669837 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.669939 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.669950 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.670105 (+ 155us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.670145 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 14:57:51.670250 24482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.656418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:38939 (local address 127.12.116.129:56061)
0620 14:57:51.666744 (+ 10326us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.666758 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 14:57:51.666864 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:57:51.667062 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:57:51.667063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:57:51.667064 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:57:51.667407 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.667422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.668327 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.668328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.669303 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:57:51.669306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.669940 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.669941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:57:51.670015 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.670019 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:57:51.670095 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 14:57:51.670142 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":75,"threads_started":1}
I20260620 14:57:51.670607 24273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac26f7cfe5334ac780b9504a3ba5b2c1" candidate_uuid: "2f200217b58a46e688cc6b874e47f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" is_pre_election: true
I20260620 14:57:51.670616 24272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac26f7cfe5334ac780b9504a3ba5b2c1" candidate_uuid: "2f200217b58a46e688cc6b874e47f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8"
I20260620 14:57:51.670814 24273 raft_consensus.cc:2454] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f200217b58a46e688cc6b874e47f821 in term 0.
I20260620 14:57:51.728369 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.723948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57664 (local address 127.12.116.129:43559)
0620 14:57:51.724158 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0620 14:57:51.724161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:57:51.724176 (+ 15us) server_negotiation.cc:407] Connection header received
0620 14:57:51.724241 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:57:51.724243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:57:51.724525 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:57:51.724647 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:57:51.724896 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.725788 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.727163 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:57:51.727494 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:57:51.727583 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:57:51.727821 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:57:51.727983 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:57:51.728084 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0620 14:57:51.728172 (+ 88us) server_negotiation.cc:299] Negotiation successful
0620 14:57:51.728205 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260620 14:57:51.730522 24391 raft_consensus.cc:1261] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f200217b58a46e688cc6b874e47f821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:57:51.730589 24273 raft_consensus.cc:3037] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:57:51.731736 24273 raft_consensus.cc:1261] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 1 FOLLOWER]: Refusing update from remote peer 2f200217b58a46e688cc6b874e47f821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:57:51.731964 24483 consensus_queue.cc:1035] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa1fd9b2195048f7ab71a83843bc4fd1" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:57:51.732266 24478 consensus_queue.cc:1035] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 2f200217b58a46e688cc6b874e47f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5978d9bf43fe48e9806ba96b9f5dd8d8" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:57:51.737615 24489 mvcc.cc:205] Tried to move back new op lower bound from 7298938764205056000 to 7298938763941875712. Current Snapshot: MvccSnapshot[applied={T|T < 7298938764205056000 or (T in {7298938764205056000})}]
I20260620 14:57:51.740764 24487 mvcc.cc:205] Tried to move back new op lower bound from 7298938764205056000 to 7298938763941875712. Current Snapshot: MvccSnapshot[applied={T|T < 7298938764205056000}]
I20260620 14:57:51.740833 23970 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:57:51.740947 23970 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:57:51.742115 23970 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3a491487f7947588c7320d3568e182d: Sending DeleteTablet for 3 replicas of tablet ac26f7cfe5334ac780b9504a3ba5b2c1
I20260620 14:57:51.742519 24115 tablet_service.cc:1514] Processing DeleteTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:57:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:57648
I20260620 14:57:51.743101 24388 tablet_service.cc:1514] Processing DeleteTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:57:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:58614
I20260620 14:57:51.743206 24253 tablet_service.cc:1514] Processing DeleteTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:57:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:36432
I20260620 14:57:51.743396 24496 tablet_replica.cc:330] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: stopping tablet replica
I20260620 14:57:51.743546 24496 raft_consensus.cc:2229] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:57:51.743106 24387 tablet_service.cc:1514] Processing DeleteTablet for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:57:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:58614
I20260620 14:57:51.743654 24496 raft_consensus.cc:2258] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:57:51.744036 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 24051
I20260620 14:57:51.748991 24497 tablet_replica.cc:330] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: stopping tablet replica
I20260620 14:57:51.749229 24497 raft_consensus.cc:2229] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:57:51.749379 24497 raft_consensus.cc:2258] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:57:51.750031 24497 ts_tablet_manager.cc:1905] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:57:51.750190 24496 ts_tablet_manager.cc:1905] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:57:51.752763 24496 ts_tablet_manager.cc:1918] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:57:51.752981 24496 log.cc:1196] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/ac26f7cfe5334ac780b9504a3ba5b2c1
I20260620 14:57:51.753362 24496 ts_tablet_manager.cc:1939] T ac26f7cfe5334ac780b9504a3ba5b2c1 P aa1fd9b2195048f7ab71a83843bc4fd1: Deleting consensus metadata
I20260620 14:57:51.754042 23955 catalog_manager.cc:4841] TS aa1fd9b2195048f7ab71a83843bc4fd1 (127.12.116.131:41331): tablet ac26f7cfe5334ac780b9504a3ba5b2c1 (table test-table [id=76c879d26a84488eae0d57262ecb90f7]) successfully deleted
W20260620 14:57:51.754535 23955 catalog_manager.cc:4808] TS aa1fd9b2195048f7ab71a83843bc4fd1 (127.12.116.131:41331): delete failed for tablet ac26f7cfe5334ac780b9504a3ba5b2c1 because the tablet was not found. No further retry: Not found: Tablet not found: ac26f7cfe5334ac780b9504a3ba5b2c1
I20260620 14:57:51.756371 24497 ts_tablet_manager.cc:1918] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:57:51.756508 24497 log.cc:1196] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/ac26f7cfe5334ac780b9504a3ba5b2c1
I20260620 14:57:51.756822 24497 ts_tablet_manager.cc:1939] T ac26f7cfe5334ac780b9504a3ba5b2c1 P 5978d9bf43fe48e9806ba96b9f5dd8d8: Deleting consensus metadata
W20260620 14:57:51.758019 23954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:43559 (error 108)
I20260620 14:57:51.758459 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 24188
I20260620 14:57:51.760671 23955 catalog_manager.cc:4841] TS 5978d9bf43fe48e9806ba96b9f5dd8d8 (127.12.116.130:38939): tablet ac26f7cfe5334ac780b9504a3ba5b2c1 (table test-table [id=76c879d26a84488eae0d57262ecb90f7]) successfully deleted
I20260620 14:57:51.764250 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:57:51.764071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43559 (local address 127.0.0.1:57670)
0620 14:57:51.764141 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 14:57:51.764194 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:43559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260620 14:57:51.764528 23954 catalog_manager.cc:4584] TS 2f200217b58a46e688cc6b874e47f821 (127.12.116.129:43559): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac26f7cfe5334ac780b9504a3ba5b2c1: Network error: Client connection negotiation failed: client connection to 127.12.116.129:43559: connect: Connection refused (error 111)
I20260620 14:57:51.764773 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 24325
I20260620 14:57:51.770627 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 23938
I20260620 14:57:51.776708 12754 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260620 14:57:52.123106 12754 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260620 14:57:52.123250 12754 mini_ranger.cc:66] Stopping Ranger...
I20260620 14:57:52.469465 12754 mini_ranger.cc:68] Stopped Ranger
2026-06-20 14:57:52.469 UTC [23524] LOG: received smart shutdown request
2026-06-20 14:57:52.474 UTC [23524] LOG: background worker "logical replication launcher" (PID 23533) exited with exit code 1
2026-06-20 14:57:52.475 UTC [23528] LOG: shutting down
2026-06-20 14:57:52.709 UTC [23524] LOG: database system is shut down
2026-06-20T14:57:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (57483 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:57:52 dist-test-slave-7v06 krb5kdc[24507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:57:52 dist-test-slave-7v06 krb5kdc[24507](info): set up 2 sockets
Jun 20 14:57:52 dist-test-slave-7v06 krb5kdc[24507](info): commencing operation
krb5kdc: starting...
W20260620 14:57:53.929010 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:57:54 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:57:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:57:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/rangeradmin_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/rangeradmin_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/rangerlookup_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/rangerlookup_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
I20260620 14:57:54.150096 12754 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskeVrfqy/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/postgres -l logfile start
2026-06-20 14:57:57.503 UTC [24537] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-20 14:57:57.503 UTC [24537] LOG: listening on IPv4 address "127.12.116.148", port 53989
2026-06-20 14:57:57.508 UTC [24537] LOG: listening on Unix socket "/tmp/.s.PGSQL.53989"
2026-06-20 14:57:57.534 UTC [24540] LOG: database system was shut down at 2026-06-20 14:57:55 UTC
2026-06-20 14:57:57.539 UTC [24537] LOG: database system is ready to accept connections
I20260620 14:57:58.557361 12754 mini_postgres.cc:96] Postgres bound to 53989
2026-06-20 14:57:58.563 UTC [24548] FATAL: database "slave" does not exist
127.12.116.148:53989 - accepting connections
I20260620 14:57:58.564489 12754 mini_ranger.cc:161] Starting Ranger...
I20260620 14:57:58.582944 12754 mini_ranger.cc:84] Created miniranger Postgres user
I20260620 14:57:59.318590 12754 mini_ranger.cc:87] Created ranger Postgres database
I20260620 14:57:59.318691 12754 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-admin
2026-06-20 14:57:59,647 [I] DB FLAVOR :POSTGRES
2026-06-20 14:57:59,648 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 14:57:59,648 [I] Checking connection..
2026-06-20 14:57:59,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-20 14:57:59,939 [I] Checking connection passed.
2026-06-20 14:57:59,939 [I] --------- Verifying version history table ---------
2026-06-20 14:57:59,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 14:58:00,293 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 14:58:00,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 14:58:00,611 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 14:58:00,612 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-20 14:58:00,612 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-20 14:58:00.922 UTC [24612] WARNING: there is no transaction in progress
2026-06-20 14:58:00,930 [I] create_dbversion_catalog.sql file imported successfully
2026-06-20 14:58:00,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 14:58:01,296 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-20 14:58:01,297 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 14:58:01,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-20 14:58:01,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-20 14:58:01,905 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7v06.c.gcp-upstream.internal','N') ;"
2026-06-20 14:58:02,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 14:58:02,556 [I] Table x_portal_user does not exist in database ranger
2026-06-20 14:58:02,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 14:58:02,853 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-20 14:58:02,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 14:58:03,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 14:58:03,487 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-20 14:58:03,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-20 14:58:04.948 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:04.974 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:04.999 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.032 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.061 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.092 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.177 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.190 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.217 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.234 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.253 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.273 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.290 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.301 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.315 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:05.329 UTC [24720] WARNING: there is no transaction in progress
2026-06-20 14:58:06,496 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-20 14:58:06,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-20 14:58:06,784 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-20 14:58:06,784 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 14:58:07,106 [I] Table x_portal_user already exists in database 'ranger'
2026-06-20 14:58:07,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 14:58:07,429 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-20 14:58:07,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 14:58:07,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 14:58:08,003 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7v06.c.gcp-upstream.internal';"
2026-06-20 14:58:08,331 [I] CORE_DB_SCHEMA import status has been updated
2026-06-20 14:58:08,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-20 14:58:08,656 [I] DB_PATCHES have already been applied
I20260620 14:58:08.663538 12754 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-admin:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskeVrfqy/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260620 14:58:08.663625 12754 mini_ranger.cc:193] Using host: 127.12.116.148
I20260620 14:58:08.668511 12754 mini_ranger.cc:227] Ranger admin URL: http://127.12.116.148:38409
Jun 20, 2026 2:58:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 2:58:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 2:58:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp
Jun 20, 2026 2:58:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 20, 2026 2:58:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 20, 2026 2:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-admin/ews/webapp].
Jun 20, 2026 2:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260620 14:58:11.144376 12754 mini_ranger.cc:160] Time spent starting Ranger: real 12.580s user 0.003s sys 0.010s
Jun 20, 2026 2:58:35 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 20, 2026 2:58:35 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 20, 2026 2:58:35 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 20, 2026 2:58:35 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 20, 2026 2:58:36 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260620 14:58:37.235098 12754 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.116.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.116.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/rangerkms_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.116.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/rangerkms_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.116.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.116.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.116.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/HTTP_127.12.116.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 20 14:58:37 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967517, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260620 14:58:37.337069 12754 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260620 14:58:37.351044 12754 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260620 14:58:38.660000 12754 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260620 14:58:38.660082 12754 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms
I20260620 14:58:38.660094 12754 mini_ranger_kms.cc:227] Using postgres at 127.12.116.148:53989
2026-06-20 14:58:38,846 [I] DB FLAVOR :POSTGRES
2026-06-20 14:58:38,846 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 14:58:38,846 [I] Checking connection
2026-06-20 14:58:38,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-20 14:58:39,145 [I] connection success
2026-06-20 14:58:39,145 [I] --------- Verifying Ranger DB tables ---------
2026-06-20 14:58:39,145 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-20 14:58:39,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-20 14:58:39,463 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-20 14:58:39,464 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 14:58:39,464 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-20 14:58:39,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.116.148:53989/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-20 14:58:39,780 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260620 14:58:40.420814 12754 mini_ranger_kms.cc:310] Created kms service
I20260620 14:58:40.670627 12754 mini_ranger_kms.cc:326] Created kudu user
I20260620 14:58:40.738962 12754 mini_ranger_kms.cc:343] Created rangerkms user
Jun 20 14:58:40 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967517, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:41.330168 12754 mini_ranger_kms.cc:384] Added ranger policy
I20260620 14:58:41.330384 12754 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms:/tmp/dist-test-taskeVrfqy/build/release/bin/postgresql.jar:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskeVrfqy/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260620 14:58:41.330408 12754 mini_ranger_kms.cc:240] Using host: 127.12.116.148
I20260620 14:58:41.333964 12754 mini_ranger_kms.cc:276] Ranger KMS PID: 24902
I20260620 14:58:41.334064 12754 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.116.148:50521
Jun 20, 2026 2:58:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 2:58:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 2:58:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 20, 2026 2:58:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 20, 2026 2:58:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-kms/ews/webapp].
Jun 20, 2026 2:58:42 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260620 14:58:43.740216 12754 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.403s user 0.001s sys 0.167s
I20260620 14:58:43.740363 12754 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260620 14:58:43.740417 12754 mini_ranger_kms.cc:401] 127.12.116.148:50521/kms/v1/keys
Jun 20 14:58:43 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781967523, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.116.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 20 14:58:44 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967523, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.116.148@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
Jun 20 14:58:44 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967523, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.116.148@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
Jun 20 14:58:47 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:58:47.611598 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34721
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:34721
--ranger_config_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:47.728935 24952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:47.729204 24952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:47.729247 24952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:47.730650 24952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:47.730744 24952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:47.730768 24952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:47.730790 24952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:47.730825 24952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:47.733351 24952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.116.148:50521/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:34721
--ranger_config_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:47.733723 24952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:47.734030 24952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:58:47.741088 24952 server_base.cc:1034] running on GCE node
W20260620 14:58:47.740983 24957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:47.741077 24958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:47.740985 24960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:47.741633 24952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:47.741989 24952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:47.743185 24952 hybrid_clock.cc:648] HybridClock initialized: now 1781967527743160 us; error 43 us; skew 500 ppm
Jun 20 14:58:47 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967527, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:47.750010 24952 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:58:47.751044 24952 webserver.cc:460] Webserver started at http://127.12.116.190:39987/ using document root <none> and password file <none>
I20260620 14:58:47.751627 24952 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:47.751708 24952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:47.751883 24952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:58:47 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967527, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:47.818856 24952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "8f4e31c2e9c144eda262059567fc9be8"
format_stamp: "Formatted at 2026-06-20 14:58:47 on dist-test-slave-7v06"
server_key: "95f666a288953e94087b64fc2ac57fd8"
server_key_iv: "201a2cdb2866c908c923872c84e55c39"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:47.819311 24952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "8f4e31c2e9c144eda262059567fc9be8"
format_stamp: "Formatted at 2026-06-20 14:58:47 on dist-test-slave-7v06"
server_key: "95f666a288953e94087b64fc2ac57fd8"
server_key_iv: "201a2cdb2866c908c923872c84e55c39"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:47.821092 24952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:47.837952 24967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:47.838201 24952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:47.838320 24952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "8f4e31c2e9c144eda262059567fc9be8"
format_stamp: "Formatted at 2026-06-20 14:58:47 on dist-test-slave-7v06"
server_key: "95f666a288953e94087b64fc2ac57fd8"
server_key_iv: "201a2cdb2866c908c923872c84e55c39"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:47.838464 24952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:47.851430 24952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:47.853760 24952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:47.853969 24952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:47.859711 24952 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:34721
I20260620 14:58:47.859733 25019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:34721 every 8 connection(s)
I20260620 14:58:47.860597 24952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:58:47.861564 25020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:47.864595 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Bootstrap starting.
I20260620 14:58:47.865775 25020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:47.866519 25020 log.cc:824] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:47.867458 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: No bootstrap required, opened a new log
I20260620 14:58:47.869956 25020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:47.870237 25020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:47.870312 25020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4e31c2e9c144eda262059567fc9be8, State: Initialized, Role: FOLLOWER
I20260620 14:58:47.870399 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 24952
I20260620 14:58:47.870503 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:58:47.870573 25020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:47.870695 12754 external_mini_cluster.cc:1428] Setting key bfdc4c88a2bf14be22514ed600ef55f2
I20260620 14:58:47.870697 25020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:58:47.870738 25020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:58:47.870790 25020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:47.871830 25020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:47.872032 25020 leader_election.cc:302] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f4e31c2e9c144eda262059567fc9be8; no voters:
I20260620 14:58:47.872243 25020 leader_election.cc:288] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:58:47.872287 25025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:58:47.872555 25025 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4e31c2e9c144eda262059567fc9be8, State: Running, Role: LEADER
I20260620 14:58:47.872694 25020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:47.872700 25025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:47.873147 25026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f4e31c2e9c144eda262059567fc9be8. Latest consensus state: current_term: 1 leader_uuid: "8f4e31c2e9c144eda262059567fc9be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } } }
I20260620 14:58:47.873229 25026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:47.873445 25030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:58:47.874080 25030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:58:47.874432 25020 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260620 14:58:47.875268 25027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f4e31c2e9c144eda262059567fc9be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } } }
I20260620 14:58:47.875433 25027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: This master's current role is: LEADER
Jun 20 14:58:47 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:47.890255 25024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:47.871260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35848 (local address 127.12.116.190:34721)
0620 14:58:47.871473 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:47.871483 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:47.871524 (+ 41us) server_negotiation.cc:407] Connection header received
0620 14:58:47.871658 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:47.871666 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:47.871743 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:47.871937 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:47.873159 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:47.874662 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:47.875852 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:47.876591 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:47.876719 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:47.882667 (+ 5948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:47.882965 (+ 298us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:47.882969 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:47.883152 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:47.887688 (+ 4536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:47.888294 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:47.888298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:47.888298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:47.888484 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:47.888734 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:47.888735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:47.888735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:47.889247 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:47.889444 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:47.889596 (+ 152us) server_negotiation.cc:299] Negotiation successful
0620 14:58:47.889911 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
I20260620 14:58:47.892189 25030 catalog_manager.cc:1347] Generated new cluster ID: 63d13902e32b4d90b9e5cf76d70e599b
I20260620 14:58:47.892282 25030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:58:47.912099 25030 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:58:47.913062 25030 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:58:47.933012 25030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Generated new TSK 0
I20260620 14:58:47.933362 25030 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:58:48.746057 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:34721
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:48.850127 25065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:48.850414 25065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:48.850456 25065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:48.851962 25065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:48.852042 25065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:48.852092 25065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:58:48.854074 25065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.116.148:50521/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:48.854424 25065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:48.854724 25065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:48.860663 25071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:48.860657 25073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:48.861037 25065 server_base.cc:1034] running on GCE node
W20260620 14:58:48.861177 25070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:48.861449 25065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:48.861770 25065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:48.862967 25065 hybrid_clock.cc:648] HybridClock initialized: now 1781967528862944 us; error 38 us; skew 500 ppm
Jun 20 14:58:48 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967528, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:48.866812 25065 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:58:48.867427 25065 webserver.cc:460] Webserver started at http://127.12.116.129:45587/ using document root <none> and password file <none>
I20260620 14:58:48.867872 25065 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:48.867967 25065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:48.868119 25065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:58:48 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967528, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:48.883347 25065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "4b5bf3ec91e8441f90def71a7337c6de"
format_stamp: "Formatted at 2026-06-20 14:58:48 on dist-test-slave-7v06"
server_key: "fb8fc609fec1098c44b7531cc25a2ae9"
server_key_iv: "c6114af2d22f772d08006da866e9294d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:48.883796 25065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "4b5bf3ec91e8441f90def71a7337c6de"
format_stamp: "Formatted at 2026-06-20 14:58:48 on dist-test-slave-7v06"
server_key: "fb8fc609fec1098c44b7531cc25a2ae9"
server_key_iv: "c6114af2d22f772d08006da866e9294d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:48.885535 25065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:58:48.907562 25080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:48.907852 25065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:58:48.907979 25065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "4b5bf3ec91e8441f90def71a7337c6de"
format_stamp: "Formatted at 2026-06-20 14:58:48 on dist-test-slave-7v06"
server_key: "fb8fc609fec1098c44b7531cc25a2ae9"
server_key_iv: "c6114af2d22f772d08006da866e9294d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:48.908113 25065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:48.928301 25065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:48.930616 25065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:48.930780 25065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:48.931026 25065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:48.931392 25065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:48.931453 25065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:48.931499 25065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:48.931525 25065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:48.938952 25065 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40383
I20260620 14:58:48.939065 25193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40383 every 8 connection(s)
I20260620 14:58:48.939429 25065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:58:48.943146 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25065
I20260620 14:58:48.943259 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:58:48.943513 12754 external_mini_cluster.cc:1428] Setting key d1a5ec23d4eb23a66e9d7936e87000c3
Jun 20 14:58:48 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967528, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:48.954032 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:48.940735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:49457 (local address 127.12.116.190:34721)
0620 14:58:48.940942 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:48.940945 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:48.941223 (+ 278us) server_negotiation.cc:407] Connection header received
0620 14:58:48.941968 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:48.941969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:48.941985 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:48.942071 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:48.943971 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:48.944761 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:48.946265 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:48.946510 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:48.946605 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:48.949685 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:48.949688 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:48.949688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:48.949699 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:48.951837 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:48.952586 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:48.952588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:48.952588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:48.952665 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:48.953077 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:48.953079 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:48.953079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:48.953235 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:48.953285 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:48.953750 (+ 465us) server_negotiation.cc:299] Negotiation successful
0620 14:58:48.953881 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":68,"threads_started":1}
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 14:58:48.955067 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:48.940676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:34721 (local address 127.12.116.129:49457)
0620 14:58:48.941033 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:48.941086 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:48.941819 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:48.942158 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:48.942168 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:48.942498 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:48.942718 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:48.942723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:48.944900 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:48.944902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:48.945966 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:48.945970 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:48.946636 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:48.946637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:48.946840 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:48.947662 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:48.947675 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:48.949530 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:48.951983 (+ 2453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:48.951999 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:48.952003 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:48.952469 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:48.952812 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:48.952813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:48.952813 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:48.952987 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:48.953338 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:48.953345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:48.953566 (+ 221us) client_negotiation.cc:769] Sending connection context
0620 14:58:48.954511 (+ 945us) client_negotiation.cc:240] Negotiation successful
0620 14:58:48.954770 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":115,"threads_started":1}
I20260620 14:58:48.955785 25194 heartbeater.cc:347] Connected to a master server at 127.12.116.190:34721
I20260620 14:58:48.955933 25194 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:48.956214 25194 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:48.956800 24984 ts_manager.cc:194] Registered new tserver with Master: 4b5bf3ec91e8441f90def71a7337c6de (127.12.116.129:40383)
I20260620 14:58:48.957571 24984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:49457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:58:48.983173 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:34721
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:49.107336 25202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:49.107677 25202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:49.107718 25202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:49.109994 25202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:49.110141 25202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:49.110215 25202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:58:49.112965 25202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.116.148:50521/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:49.113329 25202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:49.113726 25202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:49.121475 25209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:49.121567 25210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:49.121847 25212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:49.122498 25202 server_base.cc:1034] running on GCE node
I20260620 14:58:49.123037 25202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:49.123507 25202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:49.124848 25202 hybrid_clock.cc:648] HybridClock initialized: now 1781967529124811 us; error 53 us; skew 500 ppm
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:49.128846 25202 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:58:49.129568 25202 webserver.cc:460] Webserver started at http://127.12.116.130:41773/ using document root <none> and password file <none>
I20260620 14:58:49.129914 25202 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:49.130005 25202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:49.130192 25202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:49.150789 25202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "d5d493c443e84f60ba65d24a2e902117"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "9f603b113b791216b02aff5d33d197b4"
server_key_iv: "86ded7f3e3e1a874ee048e9897b51822"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.151474 25202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "d5d493c443e84f60ba65d24a2e902117"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "9f603b113b791216b02aff5d33d197b4"
server_key_iv: "86ded7f3e3e1a874ee048e9897b51822"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.160684 25202 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.000s
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:49.187824 25219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.188508 25202 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260620 14:58:49.189023 25202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "d5d493c443e84f60ba65d24a2e902117"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "9f603b113b791216b02aff5d33d197b4"
server_key_iv: "86ded7f3e3e1a874ee048e9897b51822"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.189251 25202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:49.230315 25202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:49.233198 25202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:49.233453 25202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:49.233724 25202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:49.234194 25202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:49.234294 25202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.234366 25202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:49.234427 25202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.243089 25202 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:38257
I20260620 14:58:49.243549 25332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:38257 every 8 connection(s)
I20260620 14:58:49.244119 25202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:58:49.251582 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25202
I20260620 14:58:49.251711 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:58:49.251958 12754 external_mini_cluster.cc:1428] Setting key b54a113b1153383c9a00d57719fbbd9e
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:49.260740 25335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:49.245938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:34721 (local address 127.12.116.130:52417)
0620 14:58:49.246189 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:49.246249 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:49.246993 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:49.247323 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:49.247328 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:49.247743 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:49.248069 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:49.248076 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.249187 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.249189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:49.250611 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:49.250617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.251288 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.251290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:49.251478 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:49.252379 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:49.252393 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:49.255142 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:49.258593 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:49.258610 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:49.258613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:49.259073 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:49.259369 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:49.259370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:49.259370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:49.259533 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:49.259904 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:49.259923 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:49.260128 (+ 205us) client_negotiation.cc:769] Sending connection context
0620 14:58:49.260239 (+ 111us) client_negotiation.cc:240] Negotiation successful
0620 14:58:49.260465 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":131,"threads_started":1}
I20260620 14:58:49.261217 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:49.245979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:52417 (local address 127.12.116.190:34721)
0620 14:58:49.246073 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:49.246076 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:49.246385 (+ 309us) server_negotiation.cc:407] Connection header received
0620 14:58:49.247131 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:49.247132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:49.247149 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:49.247234 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:49.248199 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.249047 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.250772 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.251133 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.251235 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:49.255319 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:49.255321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:49.255322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:49.255333 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:49.258433 (+ 3100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:49.259211 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:49.259212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:49.259213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:49.259287 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:49.259624 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:49.259625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:49.259625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:49.259788 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:49.260929 (+ 1141us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:49.260991 (+ 62us) server_negotiation.cc:299] Negotiation successful
0620 14:58:49.261097 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260620 14:58:49.262576 25333 heartbeater.cc:347] Connected to a master server at 127.12.116.190:34721
I20260620 14:58:49.262746 25333 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:49.263017 25333 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:49.263537 24984 ts_manager.cc:194] Registered new tserver with Master: d5d493c443e84f60ba65d24a2e902117 (127.12.116.130:38257)
I20260620 14:58:49.264251 24984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:52417
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:58:49.288159 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:34721
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:49.425768 25339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:49.426182 25339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:49.426268 25339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:49.428228 25339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:49.428560 25339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:49.428654 25339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:58:49.431128 25339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.116.148:50521/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:49.431691 25339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:49.432039 25339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:49.439996 25345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:49.440431 25347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:49.440474 25339 server_base.cc:1034] running on GCE node
W20260620 14:58:49.440747 25344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:49.441051 25339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:49.441411 25339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:49.448843 25339 hybrid_clock.cc:648] HybridClock initialized: now 1781967529448795 us; error 44 us; skew 500 ppm
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:49.452504 25339 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:58:49.453208 25339 webserver.cc:460] Webserver started at http://127.12.116.131:38857/ using document root <none> and password file <none>
I20260620 14:58:49.453552 25339 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:49.453675 25339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:49.453882 25339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:49.483932 25339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "bda584d190ea4ebfa808c550f5129217"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "1c11ba5ad69a116e22e68be0db3d1c1d"
server_key_iv: "34cde5aaf848bef4a4af0b3fdcc0002d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.485133 25339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "bda584d190ea4ebfa808c550f5129217"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "1c11ba5ad69a116e22e68be0db3d1c1d"
server_key_iv: "34cde5aaf848bef4a4af0b3fdcc0002d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.492985 25339 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260620 14:58:49.511552 25354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.511845 25339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 14:58:49.511969 25339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "bda584d190ea4ebfa808c550f5129217"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "1c11ba5ad69a116e22e68be0db3d1c1d"
server_key_iv: "34cde5aaf848bef4a4af0b3fdcc0002d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.512063 25339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:49.535694 25339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:49.538429 25339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:49.538591 25339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:49.538818 25339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:49.539278 25339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:49.539326 25339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.539359 25339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:49.539418 25339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.559145 25339 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:41425
I20260620 14:58:49.559185 25467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:41425 every 8 connection(s)
I20260620 14:58:49.559990 25339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:58:49.568914 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25339
I20260620 14:58:49.569034 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:58:49.569227 12754 external_mini_cluster.cc:1428] Setting key 363b9070fcb03b4408cca1caf1173637
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:49.587759 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:49.570182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:45069 (local address 127.12.116.190:34721)
0620 14:58:49.570236 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:49.570238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:49.574957 (+ 4719us) server_negotiation.cc:407] Connection header received
0620 14:58:49.575728 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:49.575730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:49.575746 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:49.575825 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:49.576852 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.577651 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.580030 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.580407 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.580457 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:49.583534 (+ 3077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:49.583536 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:49.583536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:49.583544 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:49.585651 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:49.586497 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:49.586499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:49.586499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:49.586573 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:49.586881 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:49.586882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:49.586882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:49.587048 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:49.587095 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:49.587547 (+ 452us) server_negotiation.cc:299] Negotiation successful
0620 14:58:49.587653 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:58:49.588402 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:49.570255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:34721 (local address 127.12.116.131:45069)
0620 14:58:49.574724 (+ 4469us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:49.574809 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:49.575577 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:49.575998 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:49.576004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:49.576309 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:49.576648 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:49.576655 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.577814 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.577815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:49.579583 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:49.579592 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:49.580602 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:49.580603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:49.580809 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:49.581629 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:49.581642 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:49.583388 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:49.585774 (+ 2386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:49.585792 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:49.585796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:49.586353 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:49.586653 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:49.586654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:49.586654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:49.586807 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:49.587145 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:49.587152 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:49.587365 (+ 213us) client_negotiation.cc:769] Sending connection context
0620 14:58:49.587904 (+ 539us) client_negotiation.cc:240] Negotiation successful
0620 14:58:49.588116 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4392,"thread_start_us":134,"threads_started":1}
I20260620 14:58:49.589262 25468 heartbeater.cc:347] Connected to a master server at 127.12.116.190:34721
I20260620 14:58:49.589376 25468 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:49.589620 25468 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:49.590144 24984 ts_manager.cc:194] Registered new tserver with Master: bda584d190ea4ebfa808c550f5129217 (127.12.116.131:41425)
I20260620 14:58:49.590713 24984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:45069
I20260620 14:58:49.593361 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:58:49.594586 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25065
I20260620 14:58:49.603185 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25202
I20260620 14:58:49.608994 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25339
I20260620 14:58:49.614025 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 24952
I20260620 14:58:49.622605 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34721
--webserver_interface=127.12.116.190
--webserver_port=39987
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:34721
--ranger_config_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:49.715117 25471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:49.715417 25471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:49.715445 25471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:49.717065 25471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:49.717135 25471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:49.717152 25471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:49.717167 25471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:49.717182 25471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:49.719352 25471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:34721
--ranger_config_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=39987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:49.719738 25471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:49.720072 25471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:49.726368 25476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:49.726369 25477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:49.726382 25479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:49.726857 25471 server_base.cc:1034] running on GCE node
I20260620 14:58:49.727149 25471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:49.727536 25471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:49.728717 25471 hybrid_clock.cc:648] HybridClock initialized: now 1781967529728700 us; error 31 us; skew 500 ppm
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:49.732475 25471 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:58:49.733132 25471 webserver.cc:460] Webserver started at http://127.12.116.190:39987/ using document root <none> and password file <none>
I20260620 14:58:49.733412 25471 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:49.733484 25471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:49.787233 25471 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:49.788112 25487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.788350 25471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:49.788483 25471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "8f4e31c2e9c144eda262059567fc9be8"
format_stamp: "Formatted at 2026-06-20 14:58:47 on dist-test-slave-7v06"
server_key: "95f666a288953e94087b64fc2ac57fd8"
server_key_iv: "201a2cdb2866c908c923872c84e55c39"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.788934 25471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:49.800434 25471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:49.802894 25471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:49.803074 25471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:49.808208 25471 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:34721
I20260620 14:58:49.808240 25539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:34721 every 8 connection(s)
I20260620 14:58:49.808741 25471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:58:49.810374 25540 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:58:49.811074 25540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Bootstrap starting.
I20260620 14:58:49.811838 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25471
I20260620 14:58:49.812160 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:40383
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:34721
--webserver_port=45587
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:58:49.820865 25540 log.cc:824] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:49.823171 25540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:58:49.823549 25540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Bootstrap complete.
I20260620 14:58:49.826193 25540 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:49.826527 25540 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4e31c2e9c144eda262059567fc9be8, State: Initialized, Role: FOLLOWER
I20260620 14:58:49.826803 25540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:49.826910 25540 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:58:49.826980 25540 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:58:49.827040 25540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:58:49.828293 25540 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:49.828511 25540 leader_election.cc:302] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f4e31c2e9c144eda262059567fc9be8; no voters:
I20260620 14:58:49.828740 25540 leader_election.cc:288] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 14:58:49.828785 25544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 14:58:49.829021 25544 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [term 2 LEADER]: Becoming Leader. State: Replica: 8f4e31c2e9c144eda262059567fc9be8, State: Running, Role: LEADER
I20260620 14:58:49.829172 25540 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:49.829185 25544 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } }
I20260620 14:58:49.829583 25544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8f4e31c2e9c144eda262059567fc9be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } } }
I20260620 14:58:49.829661 25544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:49.829798 25544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f4e31c2e9c144eda262059567fc9be8. Latest consensus state: current_term: 2 leader_uuid: "8f4e31c2e9c144eda262059567fc9be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f4e31c2e9c144eda262059567fc9be8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34721 } } }
I20260620 14:58:49.829854 25544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8 [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:49.830010 25548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:58:49.830611 25548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:58:49.830838 25548 catalog_manager.cc:1259] Loaded cluster ID: 63d13902e32b4d90b9e5cf76d70e599b
I20260620 14:58:49.830955 25548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:58:49.831405 25540 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260620 14:58:49.835279 25548 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:58:49.835786 25548 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Loaded TSK: 0
I20260620 14:58:49.836076 25548 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 14:58:49.920863 25542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:49.921154 25542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:49.921204 25542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:49.923097 25542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:49.923172 25542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:49.923228 25542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:58:49.926005 25542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:40383
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=45587
--tserver_master_addrs=127.12.116.190:34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:49.926366 25542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:49.926699 25542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:49.933820 25578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:49.933898 25542 server_base.cc:1034] running on GCE node
W20260620 14:58:49.933858 25580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:49.934127 25577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:49.934422 25542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:49.934780 25542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:49.936102 25542 hybrid_clock.cc:648] HybridClock initialized: now 1781967529936052 us; error 47 us; skew 500 ppm
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:49.939749 25542 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:58:49.940315 25542 webserver.cc:460] Webserver started at http://127.12.116.129:45587/ using document root <none> and password file <none>
I20260620 14:58:49.940716 25542 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:49.940809 25542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 14:58:49 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:49.978225 25542 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260620 14:58:49.979271 25588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:49.979478 25542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:58:49.979591 25542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "4b5bf3ec91e8441f90def71a7337c6de"
format_stamp: "Formatted at 2026-06-20 14:58:48 on dist-test-slave-7v06"
server_key: "fb8fc609fec1098c44b7531cc25a2ae9"
server_key_iv: "c6114af2d22f772d08006da866e9294d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:49.980042 25542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:50.005064 25542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:50.007625 25542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:50.007827 25542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:50.008134 25542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:50.008553 25542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:50.008611 25542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.008651 25542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:50.008677 25542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.015664 25542 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40383
I20260620 14:58:50.016186 25542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:58:50.021139 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25542
I20260620 14:58:50.021502 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:38257
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:34721
--webserver_port=41773
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:58:50.022507 25701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40383 every 8 connection(s)
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967529, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:50.048224 25705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.025092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:34721 (local address 127.12.116.129:33015)
0620 14:58:50.026928 (+ 1836us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:50.026988 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:50.027869 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:50.028798 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:50.028803 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:50.029176 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:50.029593 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:50.029602 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.031764 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.031766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:50.033356 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:50.033364 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.034594 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.034596 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:50.034747 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.036298 (+ 1551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:50.036312 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:50.040563 (+ 4251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:50.044716 (+ 4153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:50.044730 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:50.044734 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:50.045193 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:50.045586 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:50.045587 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:50.045587 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:50.045758 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:50.047233 (+ 1475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:50.047242 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:50.047496 (+ 254us) client_negotiation.cc:769] Sending connection context
0620 14:58:50.047638 (+ 142us) client_negotiation.cc:240] Negotiation successful
0620 14:58:50.047874 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1775,"thread_start_us":120,"threads_started":1}
I20260620 14:58:50.049661 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.025164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:33015 (local address 127.12.116.190:34721)
0620 14:58:50.026510 (+ 1346us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:50.026523 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:50.028098 (+ 1575us) server_negotiation.cc:407] Connection header received
0620 14:58:50.028277 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:50.028284 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:50.028429 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:50.028592 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:50.029758 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.031595 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.033506 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.034312 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.034453 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.040808 (+ 6355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:50.040815 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:50.040816 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:50.040835 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:50.044547 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.045325 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.045331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.045331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.045489 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.046215 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.046218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.046218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.047042 (+ 824us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:50.047181 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:50.049150 (+ 1969us) server_negotiation.cc:299] Negotiation successful
0620 14:58:50.049343 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1263,"thread_start_us":84,"threads_started":1}
I20260620 14:58:50.051152 25703 heartbeater.cc:347] Connected to a master server at 127.12.116.190:34721
I20260620 14:58:50.051270 25703 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.051514 25703 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
W20260620 14:58:50.052670 25703 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:34721 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 14:58:50.052757 25703 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.052834 25703 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:50.053288 25703 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.053375 25703 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
W20260620 14:58:50.053745 25703 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 14:58:50.154652 25702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:50.154980 25702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:50.155023 25702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:50.156977 25702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:50.157054 25702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:50.157099 25702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:58:50.159556 25702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:38257
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=41773
--tserver_master_addrs=127.12.116.190:34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:50.159901 25702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:50.160184 25702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:50.165470 25712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:50.166196 25714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:50.166546 25702 server_base.cc:1034] running on GCE node
W20260620 14:58:50.167107 25711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:50.167382 25702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:50.167713 25702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:50.168902 25702 hybrid_clock.cc:648] HybridClock initialized: now 1781967530168880 us; error 44 us; skew 500 ppm
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967530, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:50.172156 25702 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:58:50.172845 25702 webserver.cc:460] Webserver started at http://127.12.116.130:41773/ using document root <none> and password file <none>
I20260620 14:58:50.173141 25702 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:50.173225 25702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967530, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:50.197417 25702 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:58:50.198379 25722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.198583 25702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:58:50.198680 25702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "d5d493c443e84f60ba65d24a2e902117"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "9f603b113b791216b02aff5d33d197b4"
server_key_iv: "86ded7f3e3e1a874ee048e9897b51822"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:50.199106 25702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:50.215638 25702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:50.219842 25702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:50.220057 25702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:50.220378 25702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:50.220830 25702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:50.220887 25702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.220920 25702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:50.220939 25702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.230332 25702 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:38257
I20260620 14:58:50.231029 25702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:58:50.232571 25835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:38257 every 8 connection(s)
I20260620 14:58:50.238196 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25702
I20260620 14:58:50.238543 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.116.148:50521/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:41425
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:34721
--webserver_port=38857
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967530, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:50.243912 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.232539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:55401 (local address 127.12.116.190:34721)
0620 14:58:50.232587 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:50.232589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:50.232603 (+ 14us) server_negotiation.cc:407] Connection header received
0620 14:58:50.233195 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:50.233197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:50.233212 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:50.233296 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:50.234047 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.234837 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.236139 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.236496 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.236583 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.239618 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:50.239620 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:50.239620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:50.239628 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:50.241645 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.242464 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.242466 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.242466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.242574 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.242938 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.242939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.242940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.243119 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:50.243173 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:50.243655 (+ 482us) server_negotiation.cc:299] Negotiation successful
0620 14:58:50.243772 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 14:58:50.245011 25838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.232154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:34721 (local address 127.12.116.130:55401)
0620 14:58:50.232430 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:50.232483 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:50.233066 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:50.233446 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:50.233450 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:50.233663 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:50.233894 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:50.233901 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.234975 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.234976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:50.236029 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:50.236033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.236637 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.236638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:50.236775 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.237840 (+ 1065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:50.237850 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:50.239438 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:50.241788 (+ 2350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:50.241801 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:50.241805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:50.242336 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:50.242664 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:50.242665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:50.242666 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:50.242853 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:50.243230 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:50.243238 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:50.243453 (+ 215us) client_negotiation.cc:769] Sending connection context
0620 14:58:50.244407 (+ 954us) client_negotiation.cc:240] Negotiation successful
0620 14:58:50.244657 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":111,"threads_started":1}
I20260620 14:58:50.245893 25836 heartbeater.cc:347] Connected to a master server at 127.12.116.190:34721
I20260620 14:58:50.246034 25836 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.246284 25836 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
W20260620 14:58:50.247148 25836 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:34721 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 14:58:50.247229 25836 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.247313 25836 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:50.247757 25836 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.247838 25836 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
W20260620 14:58:50.248214 25836 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 14:58:50.345544 25839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:50.345908 25839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:50.345953 25839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:50.348269 25839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:50.348419 25839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:50.348475 25839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:58:50.351254 25839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.116.148:50521/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:41425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=38857
--tserver_master_addrs=127.12.116.190:34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:50.351611 25839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:50.351941 25839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:50.358683 25844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:50.358772 25847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:50.358776 25845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:50.359090 25839 server_base.cc:1034] running on GCE node
I20260620 14:58:50.359375 25839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:50.359683 25839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:50.360864 25839 hybrid_clock.cc:648] HybridClock initialized: now 1781967530360842 us; error 51 us; skew 500 ppm
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967530, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:50.365144 25839 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:58:50.365813 25839 webserver.cc:460] Webserver started at http://127.12.116.131:38857/ using document root <none> and password file <none>
I20260620 14:58:50.366250 25839 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:50.366356 25839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967530, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
I20260620 14:58:50.389895 25839 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260620 14:58:50.391001 25855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.391261 25839 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:50.391362 25839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "bda584d190ea4ebfa808c550f5129217"
format_stamp: "Formatted at 2026-06-20 14:58:49 on dist-test-slave-7v06"
server_key: "1c11ba5ad69a116e22e68be0db3d1c1d"
server_key_iv: "34cde5aaf848bef4a4af0b3fdcc0002d"
server_key_version: "kuduclusterkey@0"
I20260620 14:58:50.391906 25839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:50.418530 25839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:50.422227 25839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:50.422475 25839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:50.422833 25839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:50.423667 25839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:50.423796 25839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.423846 25839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:50.423880 25839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:50.433735 25839 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:41425
I20260620 14:58:50.434330 25839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:58:50.437227 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 25839
I20260620 14:58:50.441160 25968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:41425 every 8 connection(s)
I20260620 14:58:50.450747 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.438076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35854 (local address 127.12.116.190:34721)
0620 14:58:50.438167 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:50.438170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:50.441586 (+ 3416us) server_negotiation.cc:407] Connection header received
0620 14:58:50.441731 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:50.441733 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:50.441747 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:50.441783 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:50.442807 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.443615 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.444942 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.445274 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.445334 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.447304 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:50.447306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:50.447307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:50.447317 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:50.449169 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.449651 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.449653 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.449653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.449713 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.449912 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.449913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.449913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.450057 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:50.450233 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:50.450538 (+ 305us) server_negotiation.cc:299] Negotiation successful
0620 14:58:50.450644 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Jun 20 14:58:50 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967530, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:50.459828 25974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.441695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:56713 (local address 127.12.116.190:34721)
0620 14:58:50.449535 (+ 7840us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:50.449537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:50.449546 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:58:50.449571 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:50.449572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:50.449586 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:50.449665 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:50.450589 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.451888 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.453550 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.453778 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.453876 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.456404 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:50.456407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:50.456407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:50.456418 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:50.458107 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.458662 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.458663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.458663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.458731 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:50.459038 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:50.459039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:50.459039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:50.459183 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:50.459270 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:50.459595 (+ 325us) server_negotiation.cc:299] Negotiation successful
0620 14:58:50.459703 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7811,"thread_start_us":83,"threads_started":1}
I20260620 14:58:50.460233 25973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:50.441324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:34721 (local address 127.12.116.131:56713)
0620 14:58:50.448479 (+ 7155us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:50.448574 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:50.449301 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:50.449838 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:50.449843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:50.450125 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:50.450452 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:50.450459 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.452200 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.452201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:50.453423 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:50.453427 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:50.453931 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:50.453933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:50.454095 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:50.454734 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:50.454745 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:50.456219 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:50.458246 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:50.458259 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:50.458262 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:50.458564 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:50.458815 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:50.458815 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:50.458816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:50.458959 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:50.459256 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:50.459263 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:50.459441 (+ 178us) client_negotiation.cc:769] Sending connection context
0620 14:58:50.459559 (+ 118us) client_negotiation.cc:240] Negotiation successful
0620 14:58:50.459735 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7074,"thread_start_us":119,"threads_started":1}
I20260620 14:58:50.460783 25970 heartbeater.cc:347] Connected to a master server at 127.12.116.190:34721
I20260620 14:58:50.460908 25970 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.461127 25970 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
W20260620 14:58:50.461786 25970 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:34721 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 14:58:50.461854 25970 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.461934 25970 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:50.462235 25970 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:50.462302 25970 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
W20260620 14:58:50.462561 25970 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 14:58:51.053926 25703 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:51.054109 25703 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:51.054636 25504 ts_manager.cc:194] Registered new tserver with Master: 4b5bf3ec91e8441f90def71a7337c6de (127.12.116.129:40383)
I20260620 14:58:51.055665 25504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:33015
Jun 20 14:58:51 dist-test-slave-7v06 krb5kdc[24507](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781967531, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:51.248487 25836 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:51.248682 25836 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:51.249220 25504 ts_manager.cc:194] Registered new tserver with Master: d5d493c443e84f60ba65d24a2e902117 (127.12.116.130:38257)
I20260620 14:58:51.249768 25504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:55401
I20260620 14:58:51.462755 25970 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:51.462915 25970 heartbeater.cc:511] Master 127.12.116.190:34721 requested a full tablet report, sending...
I20260620 14:58:51.463310 25504 ts_manager.cc:194] Registered new tserver with Master: bda584d190ea4ebfa808c550f5129217 (127.12.116.131:41425)
I20260620 14:58:51.463838 25504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:56713
I20260620 14:58:51.473554 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:58:51.484856 25991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.474896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.12.116.190:34721)
0620 14:58:51.475231 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.475233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.475473 (+ 240us) server_negotiation.cc:407] Connection header received
0620 14:58:51.475507 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.475508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.475523 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.475600 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:51.476559 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.477581 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.478597 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.478943 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.479048 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.481223 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:51.481225 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:51.481226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:51.481236 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:51.483258 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:51.483699 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:51.483700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:51.483701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:51.483767 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:51.484048 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:51.484049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:51.484049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:51.484234 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:51.484367 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.484531 (+ 164us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.484632 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":74,"threads_started":1}
I20260620 14:58:51.487274 25504 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34870:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:58:51.490350 25504 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:58:51.507645 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.498503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40383 (local address 127.0.0.1:39654)
0620 14:58:51.499714 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:51.499773 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:51.499885 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:51.500379 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:51.500384 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:51.500387 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:51.500689 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.500697 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.502825 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.502827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.504792 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.504798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.507206 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.507209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.507337 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.507359 (+ 22us) client_negotiation.cc:769] Sending connection context
0620 14:58:51.507460 (+ 101us) client_negotiation.cc:240] Negotiation successful
0620 14:58:51.507541 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"thread_start_us":127,"threads_started":1}
I20260620 14:58:51.508141 25999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.498842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39654 (local address 127.12.116.129:40383)
0620 14:58:51.500130 (+ 1288us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.500134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.500146 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:58:51.500188 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.500190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.500210 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.500306 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:51.500932 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.502641 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.504986 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.506096 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.506202 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.506277 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.507984 (+ 1707us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.508052 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1250,"thread_start_us":80,"threads_started":1}
I20260620 14:58:51.508975 25628 tablet_service.cc:1467] Processing CreateTablet for tablet 06953f98432e40edb79c651909cefb08 (DEFAULT_TABLE table=test-table [id=d96a6584a29c4fd5aa55d478af7f1156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:58:51.509419 25628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06953f98432e40edb79c651909cefb08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:51.513005 26000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.498907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40456 (local address 127.12.116.131:41425)
0620 14:58:51.500041 (+ 1134us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.500047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.500682 (+ 635us) server_negotiation.cc:407] Connection header received
0620 14:58:51.500809 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.500812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.500832 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.500895 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:51.501215 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.502877 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.509324 (+ 6447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.510289 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.510359 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.510416 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.512833 (+ 2417us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.512901 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1093,"thread_start_us":52,"threads_started":1}
I20260620 14:58:51.513535 25998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.498628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:41425 (local address 127.0.0.1:40456)
0620 14:58:51.500607 (+ 1979us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:51.500620 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:51.500715 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:51.501031 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:51.501033 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:51.501036 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:51.501120 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.501123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.503030 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.503031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.505003 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.505008 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.512624 (+ 7616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.512625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.512709 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.512714 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:58:51.513371 (+ 657us) client_negotiation.cc:240] Negotiation successful
0620 14:58:51.513451 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1959,"mutex_wait_us":420,"thread_start_us":127,"threads_started":1}
I20260620 14:58:51.514482 25885 tablet_service.cc:1467] Processing CreateTablet for tablet 06953f98432e40edb79c651909cefb08 (DEFAULT_TABLE table=test-table [id=d96a6584a29c4fd5aa55d478af7f1156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:58:51.514878 25885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06953f98432e40edb79c651909cefb08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:51.520602 26003 tablet_bootstrap.cc:492] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: Bootstrap starting.
I20260620 14:58:51.520608 26004 tablet_bootstrap.cc:492] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Bootstrap starting.
I20260620 14:58:51.521756 26004 tablet_bootstrap.cc:654] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:51.521763 26003 tablet_bootstrap.cc:654] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:51.522243 26002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.499387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54522 (local address 127.12.116.130:38257)
0620 14:58:51.500539 (+ 1152us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.500544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.505342 (+ 4798us) server_negotiation.cc:407] Connection header received
0620 14:58:51.505395 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.505399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.505419 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.505508 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:51.506105 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.507436 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.511058 (+ 3622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.511874 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.512432 (+ 558us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.512518 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.522036 (+ 9518us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.522129 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1105,"thread_start_us":63,"threads_started":1}
I20260620 14:58:51.522210 26004 log.cc:824] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:51.522223 26003 log.cc:824] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:51.522833 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.499126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:38257 (local address 127.0.0.1:54522)
0620 14:58:51.505179 (+ 6053us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:51.505210 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:51.505270 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:51.505607 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:51.505608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:51.505610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:51.506017 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.506019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.507558 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.507559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.510935 (+ 3376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.510941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.521609 (+ 10668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.521611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.521738 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.521746 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 14:58:51.522658 (+ 912us) client_negotiation.cc:240] Negotiation successful
0620 14:58:51.522742 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6025,"thread_start_us":71,"threads_started":1}
I20260620 14:58:51.524286 26003 tablet_bootstrap.cc:492] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: No bootstrap required, opened a new log
I20260620 14:58:51.524489 26003 ts_tablet_manager.cc:1397] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260620 14:58:51.524555 25769 tablet_service.cc:1467] Processing CreateTablet for tablet 06953f98432e40edb79c651909cefb08 (DEFAULT_TABLE table=test-table [id=d96a6584a29c4fd5aa55d478af7f1156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:58:51.525408 25769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06953f98432e40edb79c651909cefb08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:51.528015 26003 raft_consensus.cc:348] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.528435 26003 raft_consensus.cc:374] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:51.528544 26003 raft_consensus.cc:729] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5bf3ec91e8441f90def71a7337c6de, State: Initialized, Role: FOLLOWER
I20260620 14:58:51.528820 26003 consensus_queue.cc:260] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.529268 26003 ts_tablet_manager.cc:1428] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260620 14:58:51.529448 25703 heartbeater.cc:503] Master 127.12.116.190:34721 was elected leader, sending a full tablet report...
I20260620 14:58:51.530153 26008 tablet_bootstrap.cc:492] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Bootstrap starting.
I20260620 14:58:51.530938 26008 tablet_bootstrap.cc:654] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:51.531239 26004 tablet_bootstrap.cc:492] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: No bootstrap required, opened a new log
I20260620 14:58:51.531309 26008 log.cc:824] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:51.531368 26004 ts_tablet_manager.cc:1397] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260620 14:58:51.533998 26008 tablet_bootstrap.cc:492] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: No bootstrap required, opened a new log
I20260620 14:58:51.534114 26008 ts_tablet_manager.cc:1397] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260620 14:58:51.534343 26004 raft_consensus.cc:348] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.534629 26004 raft_consensus.cc:374] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:51.534715 26004 raft_consensus.cc:729] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda584d190ea4ebfa808c550f5129217, State: Initialized, Role: FOLLOWER
I20260620 14:58:51.534904 26004 consensus_queue.cc:260] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.535282 26004 ts_tablet_manager.cc:1428] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 14:58:51.535522 25970 heartbeater.cc:503] Master 127.12.116.190:34721 was elected leader, sending a full tablet report...
I20260620 14:58:51.536667 26008 raft_consensus.cc:348] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.536875 26008 raft_consensus.cc:374] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:51.536911 26008 raft_consensus.cc:729] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d493c443e84f60ba65d24a2e902117, State: Initialized, Role: FOLLOWER
I20260620 14:58:51.537091 26008 consensus_queue.cc:260] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.537433 26008 ts_tablet_manager.cc:1428] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260620 14:58:51.537571 25836 heartbeater.cc:503] Master 127.12.116.190:34721 was elected leader, sending a full tablet report...
Jun 20 14:58:51 dist-test-slave-7v06 krb5kdc[24507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967531, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for HTTP/127.12.116.148@KRBTEST.COM
W20260620 14:58:51.692022 25971 tablet.cc:2369] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 14:58:51.734622 25837 tablet.cc:2369] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:58:51.752071 26011 raft_consensus.cc:482] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:58:51.752303 26011 raft_consensus.cc:504] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.752811 26011 leader_election.cc:288] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5bf3ec91e8441f90def71a7337c6de (127.12.116.129:40383), bda584d190ea4ebfa808c550f5129217 (127.12.116.131:41425)
I20260620 14:58:51.758046 25999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.753344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:55449 (local address 127.12.116.129:40383)
0620 14:58:51.753409 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.753412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.753559 (+ 147us) server_negotiation.cc:407] Connection header received
0620 14:58:51.753677 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.753678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.753691 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.753724 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:51.753981 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.754911 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.756850 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.757475 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.757541 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.757552 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.757898 (+ 346us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.757956 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:58:51.758397 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.753061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40383 (local address 127.12.116.130:55449)
0620 14:58:51.753469 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:51.753482 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:51.753592 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:51.753802 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:51.753803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:51.753805 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:51.753895 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.753898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.755075 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.755076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.756664 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.756671 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.757648 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.757649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.757736 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.757742 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:58:51.758229 (+ 487us) client_negotiation.cc:240] Negotiation successful
0620 14:58:51.758296 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":136,"threads_started":1}
I20260620 14:58:51.758595 26000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.753343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:36593 (local address 127.12.116.131:41425)
0620 14:58:51.753398 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.753400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.753691 (+ 291us) server_negotiation.cc:407] Connection header received
0620 14:58:51.753824 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.753825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.753837 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.753873 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:51.754122 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.754891 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.756900 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.757584 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.757649 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.757662 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.758418 (+ 756us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.758508 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:58:51.758898 25644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06953f98432e40edb79c651909cefb08" candidate_uuid: "d5d493c443e84f60ba65d24a2e902117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5bf3ec91e8441f90def71a7337c6de" is_pre_election: true
I20260620 14:58:51.759090 25644 raft_consensus.cc:2454] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d493c443e84f60ba65d24a2e902117 in term 0.
I20260620 14:58:51.759289 26013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.753068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:41425 (local address 127.12.116.130:36593)
0620 14:58:51.753606 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:51.753619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:51.753728 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:51.753953 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:51.753954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:51.753957 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:51.754039 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.754041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.755292 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.755294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.756714 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:51.756722 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.757919 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.757920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:51.758030 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.758034 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:58:51.759062 (+ 1028us) client_negotiation.cc:240] Negotiation successful
0620 14:58:51.759124 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":123,"threads_started":1}
I20260620 14:58:51.759351 25723 leader_election.cc:302] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5bf3ec91e8441f90def71a7337c6de, d5d493c443e84f60ba65d24a2e902117; no voters:
I20260620 14:58:51.759630 26011 raft_consensus.cc:2781] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:58:51.759686 26011 raft_consensus.cc:482] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:58:51.759714 26011 raft_consensus.cc:3037] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:51.760154 25906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06953f98432e40edb79c651909cefb08" candidate_uuid: "d5d493c443e84f60ba65d24a2e902117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda584d190ea4ebfa808c550f5129217" is_pre_election: true
I20260620 14:58:51.760643 25906 raft_consensus.cc:2454] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d493c443e84f60ba65d24a2e902117 in term 0.
I20260620 14:58:51.760762 26011 raft_consensus.cc:504] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.760943 26011 leader_election.cc:288] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [CANDIDATE]: Term 1 election: Requested vote from peers 4b5bf3ec91e8441f90def71a7337c6de (127.12.116.129:40383), bda584d190ea4ebfa808c550f5129217 (127.12.116.131:41425)
I20260620 14:58:51.761169 25644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06953f98432e40edb79c651909cefb08" candidate_uuid: "d5d493c443e84f60ba65d24a2e902117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5bf3ec91e8441f90def71a7337c6de"
I20260620 14:58:51.761265 25644 raft_consensus.cc:3037] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:51.761504 25906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06953f98432e40edb79c651909cefb08" candidate_uuid: "d5d493c443e84f60ba65d24a2e902117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda584d190ea4ebfa808c550f5129217"
I20260620 14:58:51.761598 25906 raft_consensus.cc:3037] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:51.762264 25644 raft_consensus.cc:2454] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5d493c443e84f60ba65d24a2e902117 in term 1.
I20260620 14:58:51.762499 25723 leader_election.cc:302] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5bf3ec91e8441f90def71a7337c6de, d5d493c443e84f60ba65d24a2e902117; no voters:
I20260620 14:58:51.762593 26011 raft_consensus.cc:2781] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:58:51.762759 26011 raft_consensus.cc:686] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 1 LEADER]: Becoming Leader. State: Replica: d5d493c443e84f60ba65d24a2e902117, State: Running, Role: LEADER
I20260620 14:58:51.762849 25906 raft_consensus.cc:2454] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5d493c443e84f60ba65d24a2e902117 in term 1.
I20260620 14:58:51.762902 26011 consensus_queue.cc:237] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } }
I20260620 14:58:51.763916 25503 catalog_manager.cc:5495] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5d493c443e84f60ba65d24a2e902117 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "d5d493c443e84f60ba65d24a2e902117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5d493c443e84f60ba65d24a2e902117" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 } health_report { overall_health: UNKNOWN } } }
W20260620 14:58:51.775741 25704 tablet.cc:2369] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:58:51.794996 26002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.791381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54534 (local address 127.12.116.130:38257)
0620 14:58:51.791443 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:51.791445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:51.791457 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:58:51.791593 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:51.791595 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:51.791658 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:51.791911 (+ 253us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:58:51.792016 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.792772 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.793916 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:51.794233 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:51.794319 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:51.794502 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:58:51.794668 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:58:51.794793 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:51.794815 (+ 22us) server_negotiation.cc:299] Negotiation successful
0620 14:58:51.794900 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 14:58:51.797224 25644 raft_consensus.cc:1261] T 06953f98432e40edb79c651909cefb08 P 4b5bf3ec91e8441f90def71a7337c6de [term 1 FOLLOWER]: Refusing update from remote peer d5d493c443e84f60ba65d24a2e902117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:58:51.797253 25906 raft_consensus.cc:1261] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 1 FOLLOWER]: Refusing update from remote peer d5d493c443e84f60ba65d24a2e902117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:58:51.797621 26011 consensus_queue.cc:1035] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda584d190ea4ebfa808c550f5129217" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 41425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:58:51.797821 26011 consensus_queue.cc:1035] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5bf3ec91e8441f90def71a7337c6de" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:58:51.800544 26017 mvcc.cc:205] Tried to move back new op lower bound from 7298939010238304256 to 7298939010101620736. Current Snapshot: MvccSnapshot[applied={T|T < 7298939010238304256}]
I20260620 14:58:51.802335 26019 mvcc.cc:205] Tried to move back new op lower bound from 7298939010238304256 to 7298939010101620736. Current Snapshot: MvccSnapshot[applied={T|T < 7298939010238304256}]
I20260620 14:58:51.803800 26018 mvcc.cc:205] Tried to move back new op lower bound from 7298939010238304256 to 7298939010101620736. Current Snapshot: MvccSnapshot[applied={T|T < 7298939010238304256}]
I20260620 14:58:51.805708 25503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:58:51.805832 25503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:58:51.806772 25503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8f4e31c2e9c144eda262059567fc9be8: Sending DeleteTablet for 3 replicas of tablet 06953f98432e40edb79c651909cefb08
I20260620 14:58:51.807267 25628 tablet_service.cc:1514] Processing DeleteTablet for tablet 06953f98432e40edb79c651909cefb08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:39654
I20260620 14:58:51.807353 25885 tablet_service.cc:1514] Processing DeleteTablet for tablet 06953f98432e40edb79c651909cefb08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:40456
I20260620 14:58:51.807801 25769 tablet_service.cc:1514] Processing DeleteTablet for tablet 06953f98432e40edb79c651909cefb08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:51 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54522
I20260620 14:58:51.808490 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25542
I20260620 14:58:51.811825 26029 tablet_replica.cc:330] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: stopping tablet replica
I20260620 14:58:51.812021 26029 raft_consensus.cc:2229] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:58:51.812268 26029 raft_consensus.cc:2258] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:58:51.816938 26029 ts_tablet_manager.cc:1905] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:58:51.819551 26030 tablet_replica.cc:330] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: stopping tablet replica
I20260620 14:58:51.819797 26030 raft_consensus.cc:2229] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:58:51.820037 26030 raft_consensus.cc:2258] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:58:51.820665 26030 ts_tablet_manager.cc:1905] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:58:51.820859 26029 ts_tablet_manager.cc:1918] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:58:51.820986 26029 log.cc:1196] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/06953f98432e40edb79c651909cefb08
I20260620 14:58:51.822629 26030 ts_tablet_manager.cc:1918] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:58:51.823132 26029 ts_tablet_manager.cc:1939] T 06953f98432e40edb79c651909cefb08 P bda584d190ea4ebfa808c550f5129217: Deleting consensus metadata
I20260620 14:58:51.823786 25491 catalog_manager.cc:4841] TS bda584d190ea4ebfa808c550f5129217 (127.12.116.131:41425): tablet 06953f98432e40edb79c651909cefb08 (table test-table [id=d96a6584a29c4fd5aa55d478af7f1156]) successfully deleted
I20260620 14:58:51.824033 26030 log.cc:1196] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/06953f98432e40edb79c651909cefb08
I20260620 14:58:51.824476 26030 ts_tablet_manager.cc:1939] T 06953f98432e40edb79c651909cefb08 P d5d493c443e84f60ba65d24a2e902117: Deleting consensus metadata
I20260620 14:58:51.824988 25490 catalog_manager.cc:4841] TS d5d493c443e84f60ba65d24a2e902117 (127.12.116.130:38257): tablet 06953f98432e40edb79c651909cefb08 (table test-table [id=d96a6584a29c4fd5aa55d478af7f1156]) successfully deleted
W20260620 14:58:51.825367 25488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:40383 (error 108)
I20260620 14:58:51.826530 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:51.826364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40383 (local address 127.0.0.1:39664)
0620 14:58:51.826443 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:51.826490 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260620 14:58:51.826789 25488 catalog_manager.cc:4584] TS 4b5bf3ec91e8441f90def71a7337c6de (127.12.116.129:40383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 06953f98432e40edb79c651909cefb08: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40383: connect: Connection refused (error 111)
I20260620 14:58:51.827075 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25702
I20260620 14:58:51.834359 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25839
I20260620 14:58:51.842644 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 25471
I20260620 14:58:51.848569 12754 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260620 14:58:52.195199 12754 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260620 14:58:52.195410 12754 mini_ranger.cc:66] Stopping Ranger...
I20260620 14:58:52.542486 12754 mini_ranger.cc:68] Stopped Ranger
2026-06-20 14:58:52.542 UTC [24537] LOG: received smart shutdown request
2026-06-20 14:58:52.548 UTC [24537] LOG: background worker "logical replication launcher" (PID 24546) exited with exit code 1
2026-06-20 14:58:52.548 UTC [24541] LOG: shutting down
2026-06-20 14:58:52.806 UTC [24537] LOG: database system is shut down
2026-06-20T14:58:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (60108 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:58:53 dist-test-slave-7v06 krb5kdc[26040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:58:53 dist-test-slave-7v06 krb5kdc[26040](info): set up 2 sockets
Jun 20 14:58:53 dist-test-slave-7v06 krb5kdc[26040](info): commencing operation
krb5kdc: starting...
W20260620 14:58:54.065003 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:58:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:58:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:58:54.213411 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37995
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37995,127.12.116.189:35439,127.12.116.188:35589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:54.310743 26053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:54.311048 26053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:54.311080 26053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:54.312885 26053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:54.312944 26053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:54.312960 26053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:54.312973 26053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:54.312987 26053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:54.314810 26053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37995,127.12.116.189:35439,127.12.116.188:35589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:54.315086 26053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:54.315294 26053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:58:54.323536 26053 server_base.cc:1034] running on GCE node
W20260620 14:58:54.323556 26058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:54.323561 26059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:54.323745 26061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:54.324105 26053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:54.324577 26053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:54.325809 26053 hybrid_clock.cc:648] HybridClock initialized: now 1781967534325795 us; error 42 us; skew 500 ppm
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:54.329620 26053 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:58:54.330401 26053 webserver.cc:460] Webserver started at http://127.12.116.190:40045/ using document root <none> and password file <none>
I20260620 14:58:54.330713 26053 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:54.330794 26053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:54.330972 26053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:54.332226 26053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "a9cecc1c4f5a66010c1d23dd342c006e"
server_key_iv: "d963ea5a6ebec8e5e4fe27d4916d7e4a"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.332724 26053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "a9cecc1c4f5a66010c1d23dd342c006e"
server_key_iv: "d963ea5a6ebec8e5e4fe27d4916d7e4a"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.334614 26053 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:58:54.336519 26068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:54.336925 26053 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:58:54.337081 26053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "a9cecc1c4f5a66010c1d23dd342c006e"
server_key_iv: "d963ea5a6ebec8e5e4fe27d4916d7e4a"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.337203 26053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:54.355883 26053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:54.358960 26053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:54.359220 26053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:54.364248 26053 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:37995
I20260620 14:58:54.364284 26120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:37995 every 8 connection(s)
I20260620 14:58:54.364753 26053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:58:54.365753 26121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:54.367842 26121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:58:54.370738 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26053
I20260620 14:58:54.370862 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:58:54.371084 12754 external_mini_cluster.cc:1428] Setting key 83e4e63665704c2b263709f71e062a44
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.189@KRBTEST.COM; defaulting to no policy
I20260620 14:58:54.384640 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.368950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37995 (local address 127.0.0.1:48568)
0620 14:58:54.369182 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.369237 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.369986 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.370296 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.370299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.370737 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.370996 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.371004 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.373309 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.373310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.374985 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.374991 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.376110 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.376112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.376214 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.377089 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.377102 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.379135 (+ 2033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.382240 (+ 3105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.382249 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.382252 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.382822 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.383201 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.383202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.383203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.383344 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.383944 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.383948 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.384025 (+ 77us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.384123 (+ 98us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.384360 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":102,"threads_started":1}
I20260620 14:58:54.385128 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.369181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48568 (local address 127.12.116.190:37995)
0620 14:58:54.369318 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.369339 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.369378 (+ 39us) server_negotiation.cc:407] Connection header received
0620 14:58:54.370169 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.370172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.370199 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.370290 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.371405 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.373143 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.375125 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.375966 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.376100 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.379255 (+ 3155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.379262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.379263 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.379270 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.382098 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.382962 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.382966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.382967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.383109 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.383423 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.383424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.383425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.383817 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.383916 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.384884 (+ 968us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.385017 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":67,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.189@KRBTEST.COM" created.
I20260620 14:58:54.385929 26121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:58:54.386912 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.386446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54586)
0620 14:58:54.386622 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.386873 (+ 251us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260620 14:58:54.387171 26071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
I20260620 14:58:54.387728 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.387583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54592)
0620 14:58:54.387646 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.387677 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260620 14:58:54.387897 26121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:35439: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab.
Entry for principal kudu/127.12.116.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab.
I20260620 14:58:54.409633 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:35439
--webserver_interface=127.12.116.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab
--principal=kudu/127.12.116.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37995,127.12.116.189:35439,127.12.116.188:35589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:58:54.437175 26121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } attempt: 1
I20260620 14:58:54.437739 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.437568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54598)
0620 14:58:54.437648 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.437702 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260620 14:58:54.438382 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.438250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54610)
0620 14:58:54.438306 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.438351 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260620 14:58:54.438576 26121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:35439: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
I20260620 14:58:54.506839 26121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } attempt: 2
I20260620 14:58:54.507804 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.507523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54616)
0620 14:58:54.507682 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.507756 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260620 14:58:54.508818 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.508608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54630)
0620 14:58:54.508689 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.508786 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260620 14:58:54.509047 26121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:35439: Network error: Client connection negotiation failed: client connection to 127.12.116.189:35439: connect: Connection refused (error 111)
W20260620 14:58:54.513907 26128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:54.514480 26128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:54.514531 26128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:54.517226 26128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:54.517329 26128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:54.517347 26128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:54.517362 26128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:54.517375 26128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:54.519723 26128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37995,127.12.116.189:35439,127.12.116.188:35589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab
--principal=kudu/127.12.116.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:35439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.116.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:54.520110 26128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:54.520485 26128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:58:54.527560 26128 server_base.cc:1034] running on GCE node
W20260620 14:58:54.527241 26136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:54.527281 26134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:54.527241 26133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:54.528090 26128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:54.528512 26128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:54.529711 26128 hybrid_clock.cc:648] HybridClock initialized: now 1781967534529632 us; error 106 us; skew 500 ppm
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:54.533392 26128 init.cc:377] Logged in from keytab as kudu/127.12.116.189@KRBTEST.COM (short username kudu)
I20260620 14:58:54.534044 26128 webserver.cc:460] Webserver started at http://127.12.116.189:34919/ using document root <none> and password file <none>
I20260620 14:58:54.534327 26128 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:54.534411 26128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:54.534602 26128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:54.535898 26128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data/instance:
uuid: "3d2ad67fbb8044828ea7d7208d8dae0c"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "1534889afd988d9b80d0fcb3a7d7dd04"
server_key_iv: "35b1b116fb4792ebc7262bdea868face"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.536389 26128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal/instance:
uuid: "3d2ad67fbb8044828ea7d7208d8dae0c"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "1534889afd988d9b80d0fcb3a7d7dd04"
server_key_iv: "35b1b116fb4792ebc7262bdea868face"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.538126 26128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:58:54.539206 26143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:54.539582 26128 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:54.539757 26128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal
uuid: "3d2ad67fbb8044828ea7d7208d8dae0c"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "1534889afd988d9b80d0fcb3a7d7dd04"
server_key_iv: "35b1b116fb4792ebc7262bdea868face"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.540185 26128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:54.588655 26128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:54.591434 26128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:54.591658 26128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:54.597571 26128 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.189:35439
I20260620 14:58:54.597669 26195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.189:35439 every 8 connection(s)
I20260620 14:58:54.598155 26128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
I20260620 14:58:54.598793 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26128
I20260620 14:58:54.599037 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-1/wal/instance
I20260620 14:58:54.599294 12754 external_mini_cluster.cc:1428] Setting key 3f1ea2b0d7b2a7b1aafad6998dfdf72e
I20260620 14:58:54.599576 26196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:54.600288 26121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } attempt: 3
I20260620 14:58:54.602152 26196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.188@KRBTEST.COM; defaulting to no policy
I20260620 14:58:54.613157 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.600953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54640)
0620 14:58:54.601236 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.601251 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.601310 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.602616 (+ 1306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.602618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.602901 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.603009 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.603013 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.605022 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.605023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.605810 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.605812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.606574 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.606575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.606660 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.607262 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.607269 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.608946 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.611270 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.611272 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.611272 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.611559 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.611928 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.611929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.611929 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.611999 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.612698 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.612699 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.612763 (+ 64us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.612855 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.613009 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.188@KRBTEST.COM" created.
I20260620 14:58:54.613751 26199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.601358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54640 (local address 127.12.116.189:35439)
0620 14:58:54.601612 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.601625 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.601666 (+ 41us) server_negotiation.cc:407] Connection header received
0620 14:58:54.602327 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.602335 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.602393 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.602536 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.603194 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.604810 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.605928 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.606467 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.606618 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.609057 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.609066 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.609067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.609075 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.611175 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.611642 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.611646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.611647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.611775 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.612084 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.612085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.612085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.612508 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.612593 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.612954 (+ 361us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.613110 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":110,"threads_started":1}
I20260620 14:58:54.614073 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.603565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.12.116.190:37995)
0620 14:58:54.603767 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.603770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.604070 (+ 300us) server_negotiation.cc:407] Connection header received
0620 14:58:54.604180 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.604181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.604193 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.604261 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.604922 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.605702 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.607461 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.607777 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.607868 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.610712 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.610713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.610714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.610721 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.612457 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.613076 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.613077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.613077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.613144 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.613389 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.613390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.613390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.613514 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.613597 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.613810 (+ 213us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.613984 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260620 14:58:54.614389 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.603546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37995 (local address 127.0.0.1:48570)
0620 14:58:54.603921 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.603970 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.604096 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.604281 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.604284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.604715 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.604797 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.604802 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.605859 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.605861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.607343 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.607349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.607905 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.607907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.608008 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.608673 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.608686 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.610594 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.612698 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.612706 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.612709 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.612994 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.613229 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.613230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.613230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.613306 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.613592 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.613599 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.613656 (+ 57us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.614163 (+ 507us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.614308 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":267,"threads_started":1}
I20260620 14:58:54.614964 26196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:58:54.615628 26121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:58:54.616025 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.615885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54618)
0620 14:58:54.615952 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.615994 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260620 14:58:54.616714 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.616601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54622)
0620 14:58:54.616651 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.616677 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260620 14:58:54.616894 26121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:35589: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 14:58:54.623346 26199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.615343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54648 (local address 127.12.116.189:35439)
0620 14:58:54.615382 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.615384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.615392 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:58:54.615436 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.615437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.615446 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.615492 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.615787 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.616490 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.617219 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.617435 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.617529 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.619689 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.619691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.619691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.619700 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.621935 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.622389 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.622390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.622391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.622457 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.622669 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.622670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.622671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.622808 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.622909 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.623061 (+ 152us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.623190 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 14:58:54.623358 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.615293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54648)
0620 14:58:54.615328 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.615340 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.615382 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.615493 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.615494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.615655 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.615694 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.615695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.616575 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.616576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.617109 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.617111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.617529 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.617530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.617587 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.618157 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.618164 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.619581 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.622080 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.622081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.622082 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.622282 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.622531 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.622532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.622532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.622599 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.622900 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.622901 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.622946 (+ 45us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.623039 (+ 93us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.623248 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16,"mutex_wait_us":102}
I20260620 14:58:54.623965 26196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:58:54.624590 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.624280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54624)
0620 14:58:54.624480 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.624551 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
W20260620 14:58:54.624984 26146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
I20260620 14:58:54.625769 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.625642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54628)
0620 14:58:54.625699 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.625737 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260620 14:58:54.625982 26196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:35589: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab.
Entry for principal kudu/127.12.116.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab.
I20260620 14:58:54.635958 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:35589
--webserver_interface=127.12.116.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab
--principal=kudu/127.12.116.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37995,127.12.116.189:35439,127.12.116.188:35589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:58:54.648084 26121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } attempt: 1
I20260620 14:58:54.648682 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.648535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54632)
0620 14:58:54.648600 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.648647 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 14:58:54.649094 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.648997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54644)
0620 14:58:54.649046 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.649074 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260620 14:58:54.649199 26121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:35589: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
I20260620 14:58:54.675280 26196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } attempt: 1
I20260620 14:58:54.675902 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.675726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54654)
0620 14:58:54.675806 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.675873 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260620 14:58:54.676260 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.676166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54666)
0620 14:58:54.676212 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.676236 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 14:58:54.676395 26196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:35589: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
W20260620 14:58:54.722074 26203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:54.722354 26203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:54.722398 26203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:54.723745 26203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:54.723846 26203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:54.723871 26203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:54.723893 26203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:54.723923 26203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:54.724347 26121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } attempt: 2
I20260620 14:58:54.724838 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.724695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54680)
0620 14:58:54.724761 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.724805 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260620 14:58:54.725188 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.725092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54682)
0620 14:58:54.725139 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.725165 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260620 14:58:54.725282 26121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:35589: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
I20260620 14:58:54.726066 26203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37995,127.12.116.189:35439,127.12.116.188:35589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab
--principal=kudu/127.12.116.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:35589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.116.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:54.726365 26203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:54.726629 26203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:54.731813 26208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:54.731824 26209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:54.731815 26211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:54.732424 26203 server_base.cc:1034] running on GCE node
I20260620 14:58:54.732944 26203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:54.733338 26203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:54.734546 26203 hybrid_clock.cc:648] HybridClock initialized: now 1781967534734521 us; error 44 us; skew 500 ppm
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:54.738250 26203 init.cc:377] Logged in from keytab as kudu/127.12.116.188@KRBTEST.COM (short username kudu)
I20260620 14:58:54.738893 26203 webserver.cc:460] Webserver started at http://127.12.116.188:45941/ using document root <none> and password file <none>
I20260620 14:58:54.739192 26203 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:54.739284 26203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:54.739459 26203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:54.740882 26203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data/instance:
uuid: "512b1b8d344b45bca46cddbc16f0eeee"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "fa05a80104c42f96f8ddde689968aa45"
server_key_iv: "f2c54061acc0e273cc061ddfad240a80"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.741360 26203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal/instance:
uuid: "512b1b8d344b45bca46cddbc16f0eeee"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "fa05a80104c42f96f8ddde689968aa45"
server_key_iv: "f2c54061acc0e273cc061ddfad240a80"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.743005 26203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:54.744076 26218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:54.744302 26203 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:54.744519 26203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal
uuid: "512b1b8d344b45bca46cddbc16f0eeee"
format_stamp: "Formatted at 2026-06-20 14:58:54 on dist-test-slave-7v06"
server_key: "fa05a80104c42f96f8ddde689968aa45"
server_key_iv: "f2c54061acc0e273cc061ddfad240a80"
server_key_version: "encryptionkey@0"
I20260620 14:58:54.744526 26196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } attempt: 2
I20260620 14:58:54.744622 26203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:54.744944 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.744825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54686)
0620 14:58:54.744876 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.744916 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260620 14:58:54.745309 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.745222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54700)
0620 14:58:54.745265 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.745291 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260620 14:58:54.745421 26196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:35589: Network error: Client connection negotiation failed: client connection to 127.12.116.188:35589: connect: Connection refused (error 111)
I20260620 14:58:54.771733 26203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:54.775084 26203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:54.775265 26203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:54.781831 26203 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.188:35589
I20260620 14:58:54.781853 26270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.188:35589 every 8 connection(s)
I20260620 14:58:54.782500 26203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
I20260620 14:58:54.783676 26271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:54.785943 26271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:58:54.792765 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26203
I20260620 14:58:54.792930 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781967351633327-12754-0/minicluster-data/master-2/wal/instance
I20260620 14:58:54.793170 12754 external_mini_cluster.cc:1428] Setting key d02f822b2eee05bcd2f7f442b342806f
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:54.799293 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.787207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.12.116.190:37995)
0620 14:58:54.787473 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.787476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.787781 (+ 305us) server_negotiation.cc:407] Connection header received
0620 14:58:54.788471 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.788473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.788485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.788558 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.789365 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.789881 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.791441 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.791679 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.791775 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.795338 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.795341 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.795342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.795368 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.797448 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.797926 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.797927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.797928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.798005 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.798452 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.798453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.798454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.798581 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.798641 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.799062 (+ 421us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.799169 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260620 14:58:54.799450 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.787117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37995 (local address 127.0.0.1:48580)
0620 14:58:54.787574 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.787631 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.788246 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.788666 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.788670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.789006 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.789245 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.789249 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.790055 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.790056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.791252 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.791260 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.792031 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.792037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.792234 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.793109 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.793119 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.795196 (+ 2077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.797546 (+ 2350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.797552 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.797555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.797837 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.798107 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.798108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.798108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.798325 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.798654 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.798660 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.798837 (+ 177us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.798975 (+ 138us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.799137 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":283,"threads_started":1}
I20260620 14:58:54.800271 26271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 14:58:54.805832 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.794375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54702 (local address 127.12.116.188:35589)
0620 14:58:54.794824 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.794831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.794865 (+ 34us) server_negotiation.cc:407] Connection header received
0620 14:58:54.794901 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.794904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.794939 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.795044 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.796272 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.797288 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.798280 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.798768 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.798844 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.802125 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.802139 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.802139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.802155 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.804103 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.804771 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.804775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.804776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.804839 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.805140 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.805141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.805141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.805374 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.805573 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.805626 (+ 53us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.805715 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":318,"threads_started":1}
I20260620 14:58:54.809150 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.800615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:35439 (local address 127.0.0.1:54660)
0620 14:58:54.800670 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.800682 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.800726 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.800968 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.800969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.801160 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.801231 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.801253 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.802310 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.802312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.802868 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.802870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.803271 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.803272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.803344 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.803817 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.803822 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.805266 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.807747 (+ 2481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.807748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.807749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.808098 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.808394 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.808395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.808396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.808469 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.808868 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.808869 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.808912 (+ 43us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.808984 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.809074 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260620 14:58:54.809516 26199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.800695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54660 (local address 127.12.116.189:35439)
0620 14:58:54.800744 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.800746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.800756 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:58:54.800784 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.800785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.800798 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.800875 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.801436 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.802205 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.802976 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.803191 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.803277 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.805382 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.805384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.805385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.805393 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.807597 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.808210 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.808211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.808212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.808284 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.808580 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.808581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.808581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.808760 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.808846 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.809058 (+ 212us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.809152 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 14:58:54.809974 26271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 14:58:54.815804 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.806877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48584 (local address 127.12.116.190:37995)
0620 14:58:54.806920 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.806922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.806930 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:58:54.807003 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.807004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.807013 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.807060 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.807748 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.808639 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.809692 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.809949 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.810031 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.812452 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.812454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.812454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.812464 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.814355 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.814830 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.814831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.814831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.814895 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.815141 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.815142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.815142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.815285 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.815560 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.815603 (+ 43us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.815684 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 14:58:54.818763 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.810583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.12.116.188:35589)
0620 14:58:54.810646 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.810648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.810685 (+ 37us) server_negotiation.cc:407] Connection header received
0620 14:58:54.810758 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.810759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.810770 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.810820 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.811086 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.811579 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.812305 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.812628 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.812710 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.814752 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.814754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.814754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.814762 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.817551 (+ 2789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.817916 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.817917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.817918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.817979 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.818174 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.818175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.818175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.818304 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.818385 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.818540 (+ 155us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.818644 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 14:58:54.818815 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.810270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54714)
0620 14:58:54.810642 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.810653 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.810703 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.810821 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.810822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.810968 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.811010 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.811011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.811666 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.811667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.812210 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.812212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.812772 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.812774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.812842 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.813297 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.813303 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.814660 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.817643 (+ 2983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.817643 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.817644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.817821 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.818047 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.818048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.818049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.818107 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.818375 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.818376 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.818419 (+ 43us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.818514 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.818695 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":85}
I20260620 14:58:54.820719 26271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee: Bootstrap starting.
I20260620 14:58:54.821841 26271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:54.822183 26271 log.cc:824] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee: Log is configured to *not* fsync() on all Append() calls
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 14:58:54.823508 26271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee: No bootstrap required, opened a new log
I20260620 14:58:54.824441 26121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } attempt: 3
I20260620 14:58:54.825851 26271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.826025 26271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:54.826076 26271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 512b1b8d344b45bca46cddbc16f0eeee, State: Initialized, Role: FOLLOWER
I20260620 14:58:54.826207 26271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.826552 26271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:54.826985 26199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.817537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54676 (local address 127.12.116.189:35439)
0620 14:58:54.817609 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.817612 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.817648 (+ 36us) server_negotiation.cc:407] Connection header received
0620 14:58:54.817683 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.817684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.817699 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.817765 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.818409 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.819589 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.820446 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.820674 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.820762 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.823597 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.823599 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.823599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.823644 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.825658 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.826045 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.826047 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.826047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.826140 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.826393 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.826395 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.826395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.826524 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.826740 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.826778 (+ 38us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.826862 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 14:58:54.827530 26283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.827806 26283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.827941 26283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:58:54.828058 26283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.829506 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:58:54.828943 26283 leader_election.cc:288] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ec980de1e8e4c2d9cc369ca78f2fa98 (127.12.116.190:37995), 3d2ad67fbb8044828ea7d7208d8dae0c (127.12.116.189:35439)
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
W20260620 14:58:54.832448 26289 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:58:54.832517 26289 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:58:54.830269 26203 master_runner.cc:186] Error getting master registration for 127.12.116.190:37995: OK, instance_id { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" instance_seqno: 1781967534362890 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 14:58:54.833030 26203 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:58:54.833741 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.824746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54730)
0620 14:58:54.824808 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.824820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.824867 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.825143 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.825145 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.825316 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.825371 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.825373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.826484 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.826485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.827320 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.827324 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.828024 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.828025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.828086 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.828599 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.828604 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.830188 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.832404 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.832405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.832405 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.832669 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.832917 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.832918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.832918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.832986 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.833380 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.833381 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.833437 (+ 56us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.833506 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.833626 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260620 14:58:54.834156 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.824875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54730 (local address 127.12.116.188:35589)
0620 14:58:54.825004 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.825006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.825015 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:58:54.825039 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.825040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.825050 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.825116 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.825465 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.826368 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.827570 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.827919 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.828273 (+ 354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.830295 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.830297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.830298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.830308 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.832209 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.832763 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.832765 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.832766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.832833 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.833057 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.833058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.833058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.833255 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.833328 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.833958 (+ 630us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.834055 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260620 14:58:54.835913 26121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: Bootstrap starting.
I20260620 14:58:54.836544 26196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } attempt: 3
I20260620 14:58:54.836781 26121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:54.837277 26121 log.cc:824] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: Log is configured to *not* fsync() on all Append() calls
Jun 20 14:58:54 dist-test-slave-7v06 krb5kdc[26040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967534, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 14:58:54.843907 26121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: No bootstrap required, opened a new log
I20260620 14:58:54.846673 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.831110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48600 (local address 127.12.116.190:37995)
0620 14:58:54.831435 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.831437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.837610 (+ 6173us) server_negotiation.cc:407] Connection header received
0620 14:58:54.837729 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.837730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.837743 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.837775 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.838529 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.839260 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.840302 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.840633 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.840684 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.842306 (+ 1622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.842308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.842308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.842316 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.844133 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.845122 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.845124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.845124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.845239 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.845695 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.845696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.845709 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.845878 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.845959 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.846462 (+ 503us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.846568 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 14:58:54.846760 26121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.846956 26121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:54.846999 26121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ec980de1e8e4c2d9cc369ca78f2fa98, State: Initialized, Role: FOLLOWER
I20260620 14:58:54.848275 26297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.833038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54732 (local address 127.12.116.188:35589)
0620 14:58:54.833291 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.833293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.833460 (+ 167us) server_negotiation.cc:407] Connection header received
0620 14:58:54.833480 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.833481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.833493 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.833551 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.834332 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.835072 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.836296 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.836638 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.840189 (+ 3551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.844151 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.844153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.844153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.844161 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.846456 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.847062 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.847064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.847064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.847136 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.847355 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.847356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.847357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.847519 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.847625 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.848041 (+ 416us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.848140 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":84,"threads_started":1}
I20260620 14:58:54.849239 26121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.849635 26199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.832771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54680 (local address 127.12.116.189:35439)
0620 14:58:54.832815 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.832818 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.833305 (+ 487us) server_negotiation.cc:407] Connection header received
0620 14:58:54.833665 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.833666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.833694 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.833726 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.835969 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.836774 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.839161 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.839469 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.839517 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.843944 (+ 4427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.843946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.843947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.843956 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.846295 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.847734 (+ 1439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.847736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.847736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.847809 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.848048 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.848049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.848049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.848195 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.848292 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.849264 (+ 972us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.849399 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 14:58:54.850076 26121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:54.850678 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "512b1b8d344b45bca46cddbc16f0eeee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" is_pre_election: true
I20260620 14:58:54.851205 26095 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 512b1b8d344b45bca46cddbc16f0eeee in term 0.
I20260620 14:58:54.851544 26219 leader_election.cc:302] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 512b1b8d344b45bca46cddbc16f0eeee, 9ec980de1e8e4c2d9cc369ca78f2fa98; no voters:
I20260620 14:58:54.851733 26283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:58:54.851823 26283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:58:54.851882 26283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:54.853183 26283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.853364 26283 leader_election.cc:288] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [CANDIDATE]: Term 1 election: Requested vote from peers 9ec980de1e8e4c2d9cc369ca78f2fa98 (127.12.116.190:37995), 3d2ad67fbb8044828ea7d7208d8dae0c (127.12.116.189:35439)
W20260620 14:58:54.853502 26311 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260620 14:58:54.853806 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.836817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:35589 (local address 127.0.0.1:54742)
0620 14:58:54.837071 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:54.837086 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:54.837142 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:54.837436 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:54.837437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:54.837639 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:54.837683 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.837686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.838603 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.838604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.839382 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:54.839385 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.839902 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.839903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:54.839963 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.840508 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:54.840514 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:54.842246 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:54.851098 (+ 8852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.851100 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.851101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.851473 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.852998 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:54.853000 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:54.853000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:54.853085 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:54.853429 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:54.853430 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:54.853492 (+ 62us) client_negotiation.cc:769] Sending connection context
0620 14:58:54.853552 (+ 60us) client_negotiation.cc:240] Negotiation successful
0620 14:58:54.853697 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
W20260620 14:58:54.853816 26311 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:58:54.854193 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:54.837234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54742 (local address 127.12.116.188:35589)
0620 14:58:54.837277 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:54.837279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:54.837286 (+ 7us) server_negotiation.cc:407] Connection header received
0620 14:58:54.837307 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:54.837308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:54.837317 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:54.837365 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:54.837764 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.838518 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.839471 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:54.839757 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:54.839842 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:54.842366 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:54.842368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:54.842369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:54.842376 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:54.850636 (+ 8260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.852798 (+ 2162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.852800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.852800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.852888 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:54.853170 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:54.853171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:54.853171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:54.853322 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:54.853969 (+ 647us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:54.854019 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 14:58:54.854111 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 14:58:54.854519 26300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.854615 26300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.855196 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "512b1b8d344b45bca46cddbc16f0eeee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98"
I20260620 14:58:54.855319 26095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:54.856441 26196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: Bootstrap starting.
I20260620 14:58:54.856544 26095 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 512b1b8d344b45bca46cddbc16f0eeee in term 1.
I20260620 14:58:54.856812 26219 leader_election.cc:302] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 512b1b8d344b45bca46cddbc16f0eeee, 9ec980de1e8e4c2d9cc369ca78f2fa98; no voters:
I20260620 14:58:54.857342 26196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:54.857702 26196 log.cc:824] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:54.858806 26196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: No bootstrap required, opened a new log
W20260620 14:58:54.860144 26074 tablet.cc:2369] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:58:54.860479 26283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:58:54.860570 26283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [term 1 LEADER]: Becoming Leader. State: Replica: 512b1b8d344b45bca46cddbc16f0eeee, State: Running, Role: LEADER
I20260620 14:58:54.860666 26283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.861042 26196 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.861197 26196 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:54.861241 26196 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2ad67fbb8044828ea7d7208d8dae0c, State: Initialized, Role: FOLLOWER
I20260620 14:58:54.861183 26277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 512b1b8d344b45bca46cddbc16f0eeee. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.861284 26277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:54.861420 26196 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } }
I20260620 14:58:54.856963 26053 master_runner.cc:186] Error getting master registration for 127.12.116.189:35439: OK, instance_id { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" instance_seqno: 1781967534595430 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 14:58:54.861658 26053 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:58:54.861795 26196 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:54.861860 26170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "512b1b8d344b45bca46cddbc16f0eeee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" is_pre_election: true
I20260620 14:58:54.861874 26169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "512b1b8d344b45bca46cddbc16f0eeee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c"
I20260620 14:58:54.862027 26170 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 512b1b8d344b45bca46cddbc16f0eeee in term 0.
I20260620 14:58:54.863016 26315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:58:54.863263 26315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260620 14:58:54.863909 26327 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:58:54.863970 26327 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:58:54.868716 26169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:54.869814 26169 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [term 1 FOLLOWER]: Refusing update from remote peer 512b1b8d344b45bca46cddbc16f0eeee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:58:54.870961 26277 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:58:54.872910 26316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.873041 26316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.873101 26316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 512b1b8d344b45bca46cddbc16f0eeee. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.873157 26316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.873795 26095 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [term 1 FOLLOWER]: Refusing update from remote peer 512b1b8d344b45bca46cddbc16f0eeee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:58:54.874200 26277 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:58:54.875854 26300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 512b1b8d344b45bca46cddbc16f0eeee. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.875984 26300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.878688 26277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.878829 26277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:54.879400 26300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.879501 26300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.879745 26329 mvcc.cc:205] Tried to move back new op lower bound from 7298939022819586048 to 7298939022790070272. Current Snapshot: MvccSnapshot[applied={T|T < 7298939022819586048}]
I20260620 14:58:54.879884 26333 mvcc.cc:205] Tried to move back new op lower bound from 7298939022819586048 to 7298939022790070272. Current Snapshot: MvccSnapshot[applied={T|T < 7298939022819586048}]
I20260620 14:58:54.880892 26283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.881002 26283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:54.881747 26316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "512b1b8d344b45bca46cddbc16f0eeee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec980de1e8e4c2d9cc369ca78f2fa98" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37995 } } peers { permanent_uuid: "3d2ad67fbb8044828ea7d7208d8dae0c" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 35439 } } peers { permanent_uuid: "512b1b8d344b45bca46cddbc16f0eeee" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 35589 } } }
I20260620 14:58:54.881860 26316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:58:54.883548 26331 mvcc.cc:205] Tried to move back new op lower bound from 7298939022819586048 to 7298939022790070272. Current Snapshot: MvccSnapshot[applied={T|T < 7298939022819586048}]
I20260620 14:58:54.884646 26315 catalog_manager.cc:1347] Generated new cluster ID: 9512d2a5a79047cfab7369b7baa09742
I20260620 14:58:54.884717 26315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:58:54.904893 26315 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:58:54.905777 26315 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:58:54.926069 26315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 512b1b8d344b45bca46cddbc16f0eeee: Generated new TSK 0
I20260620 14:58:54.926419 26315 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:58:55.854614 26311 catalog_manager.cc:1259] Loaded cluster ID: 9512d2a5a79047cfab7369b7baa09742
I20260620 14:58:55.854751 26311 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: loading cluster ID for follower catalog manager: success
I20260620 14:58:55.856113 26311 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: acquiring CA information for follower catalog manager: success
I20260620 14:58:55.856552 26311 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9ec980de1e8e4c2d9cc369ca78f2fa98: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:58:55.864514 26327 catalog_manager.cc:1259] Loaded cluster ID: 9512d2a5a79047cfab7369b7baa09742
I20260620 14:58:55.864637 26327 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: loading cluster ID for follower catalog manager: success
I20260620 14:58:55.865499 26327 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: acquiring CA information for follower catalog manager: success
I20260620 14:58:55.865818 26327 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d2ad67fbb8044828ea7d7208d8dae0c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:58:55.998543 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26053
I20260620 14:58:56.005067 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26128
I20260620 14:58:56.011159 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26203
2026-06-20T14:58:56Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3072 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:58:56 dist-test-slave-7v06 krb5kdc[26344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:58:56 dist-test-slave-7v06 krb5kdc[26344](info): set up 2 sockets
Jun 20 14:58:56 dist-test-slave-7v06 krb5kdc[26344](info): commencing operation
krb5kdc: starting...
W20260620 14:58:57.169023 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:58:57 dist-test-slave-7v06 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:58:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:58:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:58:57.319972 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37203
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:40745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:57.414567 26357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:57.414906 26357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:57.414952 26357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:57.416538 26357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:57.416646 26357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:57.416671 26357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:57.416692 26357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:57.416723 26357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:57.418633 26357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:40745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:57.419044 26357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:57.419713 26357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:57.427138 26362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:57.427192 26357 server_base.cc:1034] running on GCE node
W20260620 14:58:57.427376 26365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:57.427186 26363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:57.427841 26357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:57.428228 26357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:57.429481 26357 hybrid_clock.cc:648] HybridClock initialized: now 1781967537429468 us; error 49 us; skew 500 ppm
Jun 20 14:58:57 dist-test-slave-7v06 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967537, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:57.433542 26357 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:58:57.434170 26357 webserver.cc:460] Webserver started at http://127.12.116.190:33557/ using document root <none> and password file <none>
I20260620 14:58:57.434489 26357 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:57.434546 26357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:57.434710 26357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:57.435988 26357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "bea256dde6184e4bba0dfb3fc937b7a9"
format_stamp: "Formatted at 2026-06-20 14:58:57 on dist-test-slave-7v06"
server_key: "333c261be0bd25e4e30272dc430a3a43"
server_key_iv: "c95622fec0711a55ba9aa120d8da04a0"
server_key_version: "encryptionkey@0"
I20260620 14:58:57.436467 26357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "bea256dde6184e4bba0dfb3fc937b7a9"
format_stamp: "Formatted at 2026-06-20 14:58:57 on dist-test-slave-7v06"
server_key: "333c261be0bd25e4e30272dc430a3a43"
server_key_iv: "c95622fec0711a55ba9aa120d8da04a0"
server_key_version: "encryptionkey@0"
I20260620 14:58:57.438661 26357 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260620 14:58:57.440105 26372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:57.440413 26357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:57.440531 26357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "bea256dde6184e4bba0dfb3fc937b7a9"
format_stamp: "Formatted at 2026-06-20 14:58:57 on dist-test-slave-7v06"
server_key: "333c261be0bd25e4e30272dc430a3a43"
server_key_iv: "c95622fec0711a55ba9aa120d8da04a0"
server_key_version: "encryptionkey@0"
I20260620 14:58:57.440618 26357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:57.465451 26357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:57.468199 26357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:57.468406 26357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:57.473058 26357 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:37203
I20260620 14:58:57.473165 26424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:37203 every 8 connection(s)
I20260620 14:58:57.473775 26357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:58:57.475005 26425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:57.477883 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26357
I20260620 14:58:57.477916 26425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9: Bootstrap starting.
I20260620 14:58:57.478012 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:58:57.478245 12754 external_mini_cluster.cc:1428] Setting key 19160c31ca970fcec92858f669201069
I20260620 14:58:57.478817 26425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:57.479175 26425 log.cc:824] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:57.480049 26425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9: No bootstrap required, opened a new log
I20260620 14:58:57.482546 26425 raft_consensus.cc:348] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37203 } }
I20260620 14:58:57.482774 26425 raft_consensus.cc:374] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:57.482810 26425 raft_consensus.cc:729] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea256dde6184e4bba0dfb3fc937b7a9, State: Initialized, Role: FOLLOWER
I20260620 14:58:57.482996 26425 consensus_queue.cc:260] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37203 } }
I20260620 14:58:57.483124 26425 raft_consensus.cc:388] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:58:57.483158 26425 raft_consensus.cc:482] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:58:57.483199 26425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:57.484180 26425 raft_consensus.cc:504] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37203 } }
I20260620 14:58:57.484295 26425 leader_election.cc:302] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bea256dde6184e4bba0dfb3fc937b7a9; no voters:
I20260620 14:58:57.484560 26425 leader_election.cc:288] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:58:57.484700 26430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:58:57.484905 26425 sys_catalog.cc:564] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:57.484951 26430 raft_consensus.cc:686] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [term 1 LEADER]: Becoming Leader. State: Replica: bea256dde6184e4bba0dfb3fc937b7a9, State: Running, Role: LEADER
I20260620 14:58:57.485092 26430 consensus_queue.cc:237] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37203 } }
I20260620 14:58:57.485745 26432 sys_catalog.cc:455] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bea256dde6184e4bba0dfb3fc937b7a9. Latest consensus state: current_term: 1 leader_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37203 } } }
I20260620 14:58:57.486445 26432 sys_catalog.cc:458] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:57.486138 26431 sys_catalog.cc:455] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea256dde6184e4bba0dfb3fc937b7a9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37203 } } }
Jun 20 14:58:57 dist-test-slave-7v06 krb5kdc[26344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:57.486647 26431 sys_catalog.cc:458] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9 [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:57.486868 26442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:58:57.487457 26442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:58:57.489837 26442 catalog_manager.cc:1347] Generated new cluster ID: 11d3315428ee4a26b8727a7e8748aa82
I20260620 14:58:57.489936 26442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:58:57.492278 26428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:57.478884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47388 (local address 127.12.116.190:37203)
0620 14:58:57.479115 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:57.479133 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:57.479163 (+ 30us) server_negotiation.cc:407] Connection header received
0620 14:58:57.479724 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:57.479732 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:57.479805 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:57.479963 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:57.480857 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:57.481819 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:57.482981 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:57.483672 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:57.483812 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:57.487459 (+ 3647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:57.487465 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:57.487465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:57.487481 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:57.490274 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:57.490812 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:57.490816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:57.490816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:57.490951 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:57.491201 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:57.491202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:57.491203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:57.491575 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:57.491766 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:57.491847 (+ 81us) server_negotiation.cc:299] Negotiation successful
0620 14:58:57.492024 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":108,"threads_started":1}
I20260620 14:58:57.493456 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 14:58:57.508383 26442 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:58:57.509021 26442 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:58:57.521420 26442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bea256dde6184e4bba0dfb3fc937b7a9: Generated new TSK 0
I20260620 14:58:57.521704 26442 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:58:57.548404 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26357
2026-06-20T14:58:57Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1537 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:58:57 dist-test-slave-7v06 krb5kdc[26452](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:58:57 dist-test-slave-7v06 krb5kdc[26452](info): set up 2 sockets
Jun 20 14:58:57 dist-test-slave-7v06 krb5kdc[26452](info): commencing operation
krb5kdc: starting...
W20260620 14:58:58.644594 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:58:58 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:58:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:58:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:58:58.784272 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:39091
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:39091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:58.874034 26465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:58.874310 26465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:58.874339 26465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:58.875770 26465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:58.875842 26465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:58.875859 26465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:58.875872 26465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:58.875886 26465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:58.877818 26465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:39091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:39091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:58.878111 26465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:58.878320 26465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:58.884508 26473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:58.884516 26471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:58.884516 26470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:58.885008 26465 server_base.cc:1034] running on GCE node
I20260620 14:58:58.885325 26465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:58.885649 26465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:58.886879 26465 hybrid_clock.cc:648] HybridClock initialized: now 1781967538886844 us; error 64 us; skew 500 ppm
Jun 20 14:58:58 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967538, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:58.895921 26465 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:58:58.896685 26465 webserver.cc:460] Webserver started at http://127.12.116.190:43673/ using document root <none> and password file <none>
I20260620 14:58:58.897248 26465 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:58.897328 26465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:58.897497 26465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:58.898833 26465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "984ea399c59344f894d89048aeabeb8d"
format_stamp: "Formatted at 2026-06-20 14:58:58 on dist-test-slave-7v06"
server_key: "74c9bee309ac078e5e5e847b5aa08f67"
server_key_iv: "1b4bb40da78f9ceac476e8b8e0b50eba"
server_key_version: "encryptionkey@0"
I20260620 14:58:58.899329 26465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "984ea399c59344f894d89048aeabeb8d"
format_stamp: "Formatted at 2026-06-20 14:58:58 on dist-test-slave-7v06"
server_key: "74c9bee309ac078e5e5e847b5aa08f67"
server_key_iv: "1b4bb40da78f9ceac476e8b8e0b50eba"
server_key_version: "encryptionkey@0"
I20260620 14:58:58.901280 26465 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:58:58.902567 26480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:58.903105 26465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:58.903242 26465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "984ea399c59344f894d89048aeabeb8d"
format_stamp: "Formatted at 2026-06-20 14:58:58 on dist-test-slave-7v06"
server_key: "74c9bee309ac078e5e5e847b5aa08f67"
server_key_iv: "1b4bb40da78f9ceac476e8b8e0b50eba"
server_key_version: "encryptionkey@0"
I20260620 14:58:58.903378 26465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:58.946376 26465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:58.949409 26465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:58.949719 26465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:58.954537 26465 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:39091
I20260620 14:58:58.954703 26532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:39091 every 8 connection(s)
I20260620 14:58:58.955035 26465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:58:58.956158 26533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:58.958829 26533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap starting.
I20260620 14:58:58.959477 26533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:58.959749 26533 log.cc:824] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:58.960680 26533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: No bootstrap required, opened a new log
I20260620 14:58:58.961449 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26465
I20260620 14:58:58.961597 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:58:58.961830 12754 external_mini_cluster.cc:1428] Setting key 5ee394c923862da47474ae51708aa54d
I20260620 14:58:58.963070 26533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:58:58.963291 26533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:58.963333 26533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984ea399c59344f894d89048aeabeb8d, State: Initialized, Role: FOLLOWER
I20260620 14:58:58.963542 26533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:58:58.963634 26533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:58:58.963660 26533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:58:58.963724 26533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:58.965082 26533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:58:58.965212 26533 leader_election.cc:302] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 984ea399c59344f894d89048aeabeb8d; no voters:
I20260620 14:58:58.965411 26533 leader_election.cc:288] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:58:58.965531 26538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:58:58.966080 26538 raft_consensus.cc:686] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 LEADER]: Becoming Leader. State: Replica: 984ea399c59344f894d89048aeabeb8d, State: Running, Role: LEADER
I20260620 14:58:58.965691 26533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:58:58.966429 26538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:58:58.967172 26539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "984ea399c59344f894d89048aeabeb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } } }
I20260620 14:58:58.967401 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 984ea399c59344f894d89048aeabeb8d. Latest consensus state: current_term: 1 leader_uuid: "984ea399c59344f894d89048aeabeb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } } }
I20260620 14:58:58.967516 26539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:58.967614 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: This master's current role is: LEADER
I20260620 14:58:58.968024 26547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:58:58.968762 26547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 14:58:58 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:58.971558 26547 catalog_manager.cc:1347] Generated new cluster ID: 6138d1ab305640ef826aeac2682e4360
I20260620 14:58:58.971647 26547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:58:58.975546 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:58.962493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35964 (local address 127.12.116.190:39091)
0620 14:58:58.962760 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:58.962773 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:58.962816 (+ 43us) server_negotiation.cc:407] Connection header received
0620 14:58:58.963016 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:58.963024 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:58.963089 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:58.963263 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:58.964157 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:58.965685 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:58.966785 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:58.967549 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:58.968106 (+ 557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:58.971536 (+ 3430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:58.971541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:58.971541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:58.971557 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:58.973681 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:58.974143 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:58.974147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:58.974147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:58.974283 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:58.974523 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:58.974524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:58.974525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:58.974830 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:58.975045 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:58.975121 (+ 76us) server_negotiation.cc:299] Negotiation successful
0620 14:58:58.975290 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":111,"threads_started":1}
I20260620 14:58:59.000382 26547 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:58:59.001081 26547 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:58:59.010205 26547 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Generated new TSK 0
I20260620 14:58:59.010486 26547 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:58:59.052165 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:39091
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:59.211511 26559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:59.211768 26559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:59.211798 26559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:59.213745 26559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:59.213846 26559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:59.213886 26559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:58:59.215716 26559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:59.215992 26559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:59.216315 26559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:59.223318 26564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:59.223330 26567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:59.223353 26565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:59.225106 26559 server_base.cc:1034] running on GCE node
I20260620 14:58:59.225359 26559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:59.225646 26559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:59.226821 26559 hybrid_clock.cc:648] HybridClock initialized: now 1781967539226803 us; error 39 us; skew 500 ppm
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:59.230893 26559 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:58:59.231848 26559 webserver.cc:460] Webserver started at http://127.12.116.129:44935/ using document root <none> and password file <none>
I20260620 14:58:59.232184 26559 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:59.232273 26559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:59.232473 26559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:59.233773 26559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "a1ef9af7ecfa46a483bc5311636a250a"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "469567dff31a689c50c950b38dfe650d"
server_key_iv: "f6f59ad0ac14d89e448386844d1e6f91"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.234831 26559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "a1ef9af7ecfa46a483bc5311636a250a"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "469567dff31a689c50c950b38dfe650d"
server_key_iv: "f6f59ad0ac14d89e448386844d1e6f91"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.237927 26559 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260620 14:58:59.239307 26574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.239631 26559 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:58:59.239771 26559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "a1ef9af7ecfa46a483bc5311636a250a"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "469567dff31a689c50c950b38dfe650d"
server_key_iv: "f6f59ad0ac14d89e448386844d1e6f91"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.239914 26559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:59.258687 26559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:59.262125 26559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:59.262344 26559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:59.262624 26559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:59.263057 26559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:59.263118 26559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.263164 26559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:59.263193 26559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.271498 26559 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40361
I20260620 14:58:59.271553 26687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40361 every 8 connection(s)
I20260620 14:58:59.272023 26559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:59.281581 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26559
I20260620 14:58:59.281735 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:58:59.281956 12754 external_mini_cluster.cc:1428] Setting key 6cbf4df5d93042b67ae37a99a7d44f27
I20260620 14:58:59.284663 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.273042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:40519 (local address 127.12.116.190:39091)
0620 14:58:59.273141 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.273143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.273535 (+ 392us) server_negotiation.cc:407] Connection header received
0620 14:58:59.274115 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.274117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.274135 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.274192 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:59.275258 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.275791 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.277105 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.277345 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.277419 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.280722 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:59.280726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:59.280727 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:59.280744 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:59.282833 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.283397 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.283399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.283399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.283473 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.283760 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.283760 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.283761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.283939 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:59.284024 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.284400 (+ 376us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.284532 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260620 14:58:59.284755 26690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.273055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:40519)
0620 14:58:59.273408 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.273449 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.273976 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.274262 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.274265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.274901 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:59.275125 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.275130 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.276031 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.276033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.276977 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.276981 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.277553 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.277555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.277700 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.278373 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:59.278383 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:59.280517 (+ 2134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:59.282939 (+ 2422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:59.282956 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:59.282959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:59.283284 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:59.283555 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:59.283556 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:59.283556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:59.283683 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:59.284036 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:59.284046 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:59.284222 (+ 176us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.284373 (+ 151us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.284549 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":252,"threads_started":1}
I20260620 14:58:59.285296 26688 heartbeater.cc:347] Connected to a master server at 127.12.116.190:39091
I20260620 14:58:59.285416 26688 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:59.285625 26688 heartbeater.cc:511] Master 127.12.116.190:39091 requested a full tablet report, sending...
I20260620 14:58:59.286191 26496 ts_manager.cc:194] Registered new tserver with Master: a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361)
I20260620 14:58:59.286908 26496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:40519
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:58:59.317478 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:39091
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:59.408317 26693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:59.408691 26693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:59.408739 26693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:59.410224 26693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:59.410320 26693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:59.410374 26693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:58:59.414378 26693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:59.414871 26693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:59.415220 26693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:59.422465 26698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:59.422679 26699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:59.422799 26701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:59.422811 26693 server_base.cc:1034] running on GCE node
I20260620 14:58:59.423079 26693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:59.423408 26693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:59.424654 26693 hybrid_clock.cc:648] HybridClock initialized: now 1781967539424628 us; error 43 us; skew 500 ppm
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:59.429287 26693 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:58:59.429932 26693 webserver.cc:460] Webserver started at http://127.12.116.130:42397/ using document root <none> and password file <none>
I20260620 14:58:59.430193 26693 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:59.430269 26693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:59.430445 26693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:59.431694 26693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "6ba4f5eaab3a4716aaf6a57864d0b790"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "0e5b49d1eba8b0fd7907a5a94054c116"
server_key_iv: "7d1c6da4dc7a97efbd4a919e608a80f3"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.432176 26693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "6ba4f5eaab3a4716aaf6a57864d0b790"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "0e5b49d1eba8b0fd7907a5a94054c116"
server_key_iv: "7d1c6da4dc7a97efbd4a919e608a80f3"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.434042 26693 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260620 14:58:59.435755 26708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.436282 26693 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:58:59.436506 26693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6ba4f5eaab3a4716aaf6a57864d0b790"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "0e5b49d1eba8b0fd7907a5a94054c116"
server_key_iv: "7d1c6da4dc7a97efbd4a919e608a80f3"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.436596 26693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:59.452857 26693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:59.455570 26693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:59.455710 26693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:59.455919 26693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:59.456308 26693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:59.456386 26693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.456413 26693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:59.456426 26693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.463438 26693 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:44251
I20260620 14:58:59.463541 26821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:44251 every 8 connection(s)
I20260620 14:58:59.463891 26693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:58:59.465116 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26693
I20260620 14:58:59.465265 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:58:59.465523 12754 external_mini_cluster.cc:1428] Setting key 247163fbc1829ad7532d8f836a7eeb3c
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:58:59.478045 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.465139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:43685 (local address 127.12.116.190:39091)
0620 14:58:59.465196 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.465198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.465497 (+ 299us) server_negotiation.cc:407] Connection header received
0620 14:58:59.466369 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.466370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.466384 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.466476 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:59.468235 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.469215 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.470488 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.470812 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.470895 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.473919 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:59.473922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:59.473922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:59.473939 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:59.475800 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.476829 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.476831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.476831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.476946 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.477252 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.477253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.477253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.477407 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:59.477496 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.477808 (+ 312us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.477933 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 14:58:59.478266 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.465011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:43685)
0620 14:58:59.465310 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.465375 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.466223 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.466602 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.466606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.467659 (+ 1053us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:59.468005 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.468015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.469372 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.469374 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.470371 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.470375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.470941 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.470942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.471122 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.471786 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:59.471797 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:59.473767 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:59.476002 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:59.476142 (+ 140us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:59.476153 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:59.476674 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:59.477054 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:59.477055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:59.477056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:59.477177 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:59.477487 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:59.477495 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:59.477662 (+ 167us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.477788 (+ 126us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.477981 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":116,"threads_started":1}
I20260620 14:58:59.479409 26822 heartbeater.cc:347] Connected to a master server at 127.12.116.190:39091
I20260620 14:58:59.479723 26822 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:59.480041 26822 heartbeater.cc:511] Master 127.12.116.190:39091 requested a full tablet report, sending...
I20260620 14:58:59.480837 26496 ts_manager.cc:194] Registered new tserver with Master: 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251)
I20260620 14:58:59.481491 26496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:43685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:58:59.501510 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:39091
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:59.604664 26827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:59.605010 26827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:59.605055 26827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:59.607349 26827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:59.607424 26827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:59.607461 26827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:58:59.610205 26827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:59.610567 26827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:59.610913 26827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:59.617501 26832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:59.617497 26833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:59.617887 26827 server_base.cc:1034] running on GCE node
W20260620 14:58:59.617940 26835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:59.618208 26827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:59.619271 26827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:59.620632 26827 hybrid_clock.cc:648] HybridClock initialized: now 1781967539620624 us; error 41 us; skew 500 ppm
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:59.624413 26827 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:58:59.625011 26827 webserver.cc:460] Webserver started at http://127.12.116.131:44723/ using document root <none> and password file <none>
I20260620 14:58:59.625268 26827 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:59.625324 26827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:58:59.625427 26827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:58:59.626583 26827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "03b830ad64124be0bd6368c0e1a74737"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "f372e3447e33c1f41bde368da0d1ae72"
server_key_iv: "5c5dc1ec549ee43bd265c9cbc25b627c"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.626979 26827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "03b830ad64124be0bd6368c0e1a74737"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "f372e3447e33c1f41bde368da0d1ae72"
server_key_iv: "5c5dc1ec549ee43bd265c9cbc25b627c"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.629536 26827 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 14:58:59.630712 26842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.631345 26827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:58:59.631446 26827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "03b830ad64124be0bd6368c0e1a74737"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "f372e3447e33c1f41bde368da0d1ae72"
server_key_iv: "5c5dc1ec549ee43bd265c9cbc25b627c"
server_key_version: "encryptionkey@0"
I20260620 14:58:59.631590 26827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:58:59.653647 26827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:58:59.658862 26827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:58:59.659014 26827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:58:59.659361 26827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:58:59.659737 26827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:58:59.659776 26827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.659801 26827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:58:59.659813 26827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:58:59.668159 26827 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:40969
I20260620 14:58:59.668207 26955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:40969 every 8 connection(s)
I20260620 14:58:59.668948 26827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:58:59.669446 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 26827
I20260620 14:58:59.669588 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:58:59.670024 12754 external_mini_cluster.cc:1428] Setting key d958c96e5419ebde31f41ca78afb8458
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:58:59.682994 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.670338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:46741 (local address 127.12.116.190:39091)
0620 14:58:59.670420 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.670424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.671002 (+ 578us) server_negotiation.cc:407] Connection header received
0620 14:58:59.672015 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.672016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.672033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.672087 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:59.673491 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.674367 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.675741 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.675972 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.676144 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.679292 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:59.679294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:59.679295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:59.679339 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:59.681321 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.681892 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.681893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.681894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.681962 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.682254 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.682255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.682255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.682393 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:59.682469 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.682790 (+ 321us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.682886 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 14:58:59.683265 26958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.670247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:46741)
0620 14:58:59.670763 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.670833 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.671767 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.672213 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.672218 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.673064 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:58:59.673355 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.673360 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.674601 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.674604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.675599 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.675603 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.676161 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.676163 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.676392 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.677194 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:58:59.677205 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:58:59.679132 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:58:59.681449 (+ 2317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:59.681465 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:59.681469 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:59.681777 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:59.682040 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:58:59.682041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:58:59.682041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:58:59.682170 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:58:59.682472 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:58:59.682480 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:58:59.682644 (+ 164us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.682768 (+ 124us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.682967 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":403,"threads_started":1}
I20260620 14:58:59.683930 26956 heartbeater.cc:347] Connected to a master server at 127.12.116.190:39091
I20260620 14:58:59.684139 26956 heartbeater.cc:464] Registering TS with master...
I20260620 14:58:59.684583 26956 heartbeater.cc:511] Master 127.12.116.190:39091 requested a full tablet report, sending...
I20260620 14:58:59.685415 26496 ts_manager.cc:194] Registered new tserver with Master: 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
I20260620 14:58:59.685892 26496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:46741
I20260620 14:58:59.693701 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:58:59.703641 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.695458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.12.116.190:39091)
0620 14:58:59.695554 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.695557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.695691 (+ 134us) server_negotiation.cc:407] Connection header received
0620 14:58:59.695841 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.695842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.695854 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.695921 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:58:59.696775 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.697363 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.698202 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.698432 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.698517 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.700323 (+ 1806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:58:59.700379 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:58:59.700379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:58:59.700397 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:58:59.702210 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.702683 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.702684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.702685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.702751 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:58:59.702963 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:58:59.702964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:58:59.702965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:58:59.703156 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:58:59.703280 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.703426 (+ 146us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.703528 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260620 14:58:59.706130 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:58:59.709004 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:58:59.719445 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.714235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44251 (local address 127.0.0.1:35246)
0620 14:58:59.714691 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.714702 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.714745 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.715147 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.715149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.715153 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:59.715255 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.715258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.716669 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.716670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.718065 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.718069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.718997 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.718999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.719109 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.719128 (+ 19us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.719220 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.719297 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":6,"thread_start_us":179,"threads_started":1}
I20260620 14:58:59.719477 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.714629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.12.116.130:44251)
0620 14:58:59.714883 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.714890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.714909 (+ 19us) server_negotiation.cc:407] Connection header received
0620 14:58:59.714971 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.714974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.714995 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.715386 (+ 391us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:59.715473 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.716245 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.718247 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.718871 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.718997 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.719077 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.719294 (+ 217us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.719361 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":94,"threads_started":1}
I20260620 14:58:59.719611 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.714053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60564 (local address 127.12.116.129:40361)
0620 14:58:59.714246 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.714252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.714436 (+ 184us) server_negotiation.cc:407] Connection header received
0620 14:58:59.714631 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.714635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.714655 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.714722 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:59.715101 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.716308 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.718070 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.718925 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.719023 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.719100 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.719441 (+ 341us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.719517 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":105,"threads_started":1}
I20260620 14:58:59.719797 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.713941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40361 (local address 127.0.0.1:60564)
0620 14:58:59.714277 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.714332 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.714455 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.714845 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.714860 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.714866 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:59.714987 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.714991 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.716478 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.716479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.717928 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.717934 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.719141 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.719142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.719209 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.719213 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.719264 (+ 51us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.719308 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":94,"thread_start_us":94,"threads_started":1}
I20260620 14:58:59.720089 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.714235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40969 (local address 127.0.0.1:54806)
0620 14:58:59.714508 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.714520 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.714570 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.715268 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.715269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.715272 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:59.715342 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.715345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.716815 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.716816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.718065 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.718069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.719075 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.719076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.719272 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.719279 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.719332 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.719383 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":3,"thread_start_us":193,"threads_started":1}
I20260620 14:58:59.720515 26972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.714732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54806 (local address 127.12.116.131:40969)
0620 14:58:59.715059 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.715067 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.715078 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:58:59.715124 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.715126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.715147 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.715440 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:59.715514 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.716700 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.718195 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.718965 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.719519 (+ 554us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.719598 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.719631 (+ 33us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.720417 (+ 786us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":180,"threads_started":1}
I20260620 14:58:59.720780 26622 tablet_service.cc:1467] Processing CreateTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 (DEFAULT_TABLE table=test-table [id=50b9c636e00648ed9e1340a1fa893022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:58:59.720780 26756 tablet_service.cc:1467] Processing CreateTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 (DEFAULT_TABLE table=test-table [id=50b9c636e00648ed9e1340a1fa893022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:58:59.721268 26756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56ba6f3dabc643ab86fd822207114ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:59.721272 26622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56ba6f3dabc643ab86fd822207114ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:59.721242 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 (DEFAULT_TABLE table=test-table [id=50b9c636e00648ed9e1340a1fa893022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:58:59.721603 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56ba6f3dabc643ab86fd822207114ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:58:59.724586 26973 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Bootstrap starting.
I20260620 14:58:59.725335 26973 tablet_bootstrap.cc:654] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:59.725915 26973 log.cc:824] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:59.726541 26974 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap starting.
I20260620 14:58:59.726903 26973 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: No bootstrap required, opened a new log
I20260620 14:58:59.726998 26973 ts_tablet_manager.cc:1397] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:58:59.727011 26976 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Bootstrap starting.
I20260620 14:58:59.727324 26974 tablet_bootstrap.cc:654] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:59.727707 26976 tablet_bootstrap.cc:654] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Neither blocks nor log segments found. Creating new log.
I20260620 14:58:59.728101 26974 log.cc:824] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:59.728570 26976 log.cc:824] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Log is configured to *not* fsync() on all Append() calls
I20260620 14:58:59.729143 26974 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: No bootstrap required, opened a new log
I20260620 14:58:59.729242 26974 ts_tablet_manager.cc:1397] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:58:59.729413 26976 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: No bootstrap required, opened a new log
I20260620 14:58:59.729492 26976 ts_tablet_manager.cc:1397] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:58:59.729518 26973 raft_consensus.cc:348] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.729729 26973 raft_consensus.cc:374] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:59.729768 26973 raft_consensus.cc:729] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba4f5eaab3a4716aaf6a57864d0b790, State: Initialized, Role: FOLLOWER
I20260620 14:58:59.729928 26973 consensus_queue.cc:260] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.730250 26973 ts_tablet_manager.cc:1428] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260620 14:58:59.730432 26822 heartbeater.cc:503] Master 127.12.116.190:39091 was elected leader, sending a full tablet report...
I20260620 14:58:59.731235 26974 raft_consensus.cc:348] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.731376 26974 raft_consensus.cc:374] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:59.731398 26974 raft_consensus.cc:729] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ef9af7ecfa46a483bc5311636a250a, State: Initialized, Role: FOLLOWER
I20260620 14:58:59.731536 26974 consensus_queue.cc:260] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.731875 26688 heartbeater.cc:503] Master 127.12.116.190:39091 was elected leader, sending a full tablet report...
I20260620 14:58:59.731873 26974 ts_tablet_manager.cc:1428] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 14:58:59.731730 26976 raft_consensus.cc:348] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.732290 26976 raft_consensus.cc:374] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:58:59.732348 26976 raft_consensus.cc:729] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03b830ad64124be0bd6368c0e1a74737, State: Initialized, Role: FOLLOWER
I20260620 14:58:59.732514 26976 consensus_queue.cc:260] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.732982 26956 heartbeater.cc:503] Master 127.12.116.190:39091 was elected leader, sending a full tablet report...
I20260620 14:58:59.733007 26976 ts_tablet_manager.cc:1428] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
W20260620 14:58:59.772991 26689 tablet.cc:2369] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:58:59.808105 26979 raft_consensus.cc:482] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:58:59.808250 26979 raft_consensus.cc:504] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.808686 26979 leader_election.cc:288] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
I20260620 14:58:59.811896 26972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.809011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:58781 (local address 127.12.116.131:40969)
0620 14:58:59.809059 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.809062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.809313 (+ 251us) server_negotiation.cc:407] Connection header received
0620 14:58:59.809344 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.809345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.809356 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.809415 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:59.809626 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.810114 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.811036 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.811583 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.811644 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.811654 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.811791 (+ 137us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.811826 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:58:59.811892 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.808899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40361 (local address 127.12.116.130:48073)
0620 14:58:59.808952 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.808965 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.809016 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.809184 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.809185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.809187 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:59.809281 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.809284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.810052 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.810053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.810873 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.810875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.811593 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.811594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.811685 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.811689 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.811738 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.811787 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260620 14:58:59.811936 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.809004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:48073 (local address 127.12.116.129:40361)
0620 14:58:59.809053 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.809055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.809065 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:58:59.809094 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.809095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.809113 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.809180 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:58:59.809399 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.809974 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.811019 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.811520 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.811587 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.811596 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.811777 (+ 181us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.811826 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 14:58:59.811897 26982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.808946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40969 (local address 127.12.116.130:58781)
0620 14:58:59.809202 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.809212 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:58:59.809279 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:58:59.809429 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:58:59.809429 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:58:59.809431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:58:59.809548 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.809550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.810197 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.810198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.810916 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:58:59.810918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.811656 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.811656 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:58:59.811715 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.811718 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 14:58:59.811769 (+ 51us) client_negotiation.cc:240] Negotiation successful
0620 14:58:59.811797 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":204,"threads_started":1}
I20260620 14:58:59.812491 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56ba6f3dabc643ab86fd822207114ea3" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03b830ad64124be0bd6368c0e1a74737" is_pre_election: true
I20260620 14:58:59.812558 26642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56ba6f3dabc643ab86fd822207114ea3" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ef9af7ecfa46a483bc5311636a250a" is_pre_election: true
I20260620 14:58:59.812665 26910 raft_consensus.cc:2454] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 0.
I20260620 14:58:59.812739 26642 raft_consensus.cc:2454] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 0.
I20260620 14:58:59.812906 26711 leader_election.cc:302] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790; no voters:
I20260620 14:58:59.813042 26979 raft_consensus.cc:2781] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:58:59.813098 26979 raft_consensus.cc:482] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:58:59.813122 26979 raft_consensus.cc:3037] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:59.813812 26979 raft_consensus.cc:504] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.813977 26979 leader_election.cc:288] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 election: Requested vote from peers a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
I20260620 14:58:59.814167 26642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56ba6f3dabc643ab86fd822207114ea3" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ef9af7ecfa46a483bc5311636a250a"
I20260620 14:58:59.814195 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56ba6f3dabc643ab86fd822207114ea3" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03b830ad64124be0bd6368c0e1a74737"
I20260620 14:58:59.814272 26642 raft_consensus.cc:3037] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:59.814291 26910 raft_consensus.cc:3037] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:58:59.814980 26910 raft_consensus.cc:2454] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 1.
I20260620 14:58:59.815042 26642 raft_consensus.cc:2454] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 1.
I20260620 14:58:59.815145 26711 leader_election.cc:302] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790; no voters:
I20260620 14:58:59.815303 26979 raft_consensus.cc:2781] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:58:59.815452 26979 raft_consensus.cc:686] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 LEADER]: Becoming Leader. State: Replica: 6ba4f5eaab3a4716aaf6a57864d0b790, State: Running, Role: LEADER
I20260620 14:58:59.815529 26979 consensus_queue.cc:237] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:58:59.816483 26496 catalog_manager.cc:5495] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260620 14:58:59.840595 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.837536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35260 (local address 127.12.116.130:44251)
0620 14:58:59.837601 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 14:58:59.837603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:58:59.837621 (+ 18us) server_negotiation.cc:407] Connection header received
0620 14:58:59.837659 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:58:59.837660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:58:59.837682 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:58:59.837765 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:58:59.837894 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.838420 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.839279 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:58:59.839685 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:58:59.839837 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:58:59.840104 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:58:59.840250 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:58:59.840438 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0620 14:58:59.840459 (+ 21us) server_negotiation.cc:299] Negotiation successful
0620 14:58:59.840495 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260620 14:58:59.842924 26910 raft_consensus.cc:1261] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Refusing update from remote peer 6ba4f5eaab3a4716aaf6a57864d0b790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:58:59.843011 26642 raft_consensus.cc:1261] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Refusing update from remote peer 6ba4f5eaab3a4716aaf6a57864d0b790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:58:59.843297 26979 consensus_queue.cc:1035] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:58:59.843473 26983 consensus_queue.cc:1035] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:58:59.846452 26986 mvcc.cc:205] Tried to move back new op lower bound from 7298939043192942592 to 7298939043085074432. Current Snapshot: MvccSnapshot[applied={T|T < 7298939043192942592}]
I20260620 14:58:59.849643 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:58:59.849756 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:58:59.850786 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Sending DeleteTablet for 3 replicas of tablet 56ba6f3dabc643ab86fd822207114ea3
I20260620 14:58:59.851284 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:59 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:35246
I20260620 14:58:59.851491 26622 tablet_service.cc:1514] Processing DeleteTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:59 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60564
I20260620 14:58:59.851627 26997 tablet_replica.cc:330] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: stopping tablet replica
I20260620 14:58:59.851744 26997 raft_consensus.cc:2229] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:58:59.851917 26997 raft_consensus.cc:2258] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:58:59.852026 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26559
I20260620 14:58:59.852020 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:59 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54806
I20260620 14:58:59.854001 26997 ts_tablet_manager.cc:1905] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:58:59.856506 26997 ts_tablet_manager.cc:1918] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:58:59.856634 26997 log.cc:1196] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/56ba6f3dabc643ab86fd822207114ea3
I20260620 14:58:59.856547 26999 tablet_replica.cc:330] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: stopping tablet replica
I20260620 14:58:59.856930 26999 raft_consensus.cc:2229] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:58:59.856950 26997 ts_tablet_manager.cc:1939] T 56ba6f3dabc643ab86fd822207114ea3 P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting consensus metadata
I20260620 14:58:59.857203 26999 raft_consensus.cc:2258] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:58:59.857599 26484 catalog_manager.cc:4841] TS 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251): tablet 56ba6f3dabc643ab86fd822207114ea3 (table test-table [id=50b9c636e00648ed9e1340a1fa893022]) successfully deleted
I20260620 14:58:59.857865 26999 ts_tablet_manager.cc:1905] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 14:58:59.858820 26481 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:40361 (error 108)
I20260620 14:58:59.859267 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26693
I20260620 14:58:59.859426 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:58:59.859247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40361 (local address 127.0.0.1:60572)
0620 14:58:59.859329 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0620 14:58:59.859385 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260620 14:58:59.860373 26999 ts_tablet_manager.cc:1918] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260620 14:58:59.860406 26481 catalog_manager.cc:4584] TS a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 56ba6f3dabc643ab86fd822207114ea3: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40361: connect: Connection refused (error 111)
I20260620 14:58:59.860452 26999 log.cc:1196] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/56ba6f3dabc643ab86fd822207114ea3
I20260620 14:58:59.860762 26999 ts_tablet_manager.cc:1939] T 56ba6f3dabc643ab86fd822207114ea3 P 03b830ad64124be0bd6368c0e1a74737: Deleting consensus metadata
I20260620 14:58:59.861560 26483 catalog_manager.cc:4841] TS 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): tablet 56ba6f3dabc643ab86fd822207114ea3 (table test-table [id=50b9c636e00648ed9e1340a1fa893022]) successfully deleted
I20260620 14:58:59.865528 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26827
I20260620 14:58:59.872514 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 26465
I20260620 14:58:59.879135 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:39091
--webserver_interface=127.12.116.190
--webserver_port=43673
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:39091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:58:59.977044 27001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:58:59.977299 27001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:58:59.977329 27001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:58:59.978721 27001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:58:59.979117 27001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:58:59.979202 27001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:58:59.979223 27001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:58:59.979264 27001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:58:59.981498 27001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:39091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:39091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=43673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:58:59.981873 27001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:58:59.982198 27001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:58:59.992374 27008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:59.992496 27001 server_base.cc:1034] running on GCE node
W20260620 14:58:59.992513 27010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:58:59.992626 27007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:58:59.992988 27001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:58:59.993364 27001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:58:59.994679 27001 hybrid_clock.cc:648] HybridClock initialized: now 1781967539994664 us; error 67 us; skew 500 ppm
Jun 20 14:58:59 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967539, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:58:59.997807 27001 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:58:59.998492 27001 webserver.cc:460] Webserver started at http://127.12.116.190:43673/ using document root <none> and password file <none>
I20260620 14:58:59.998776 27001 fs_manager.cc:359] Metadata directory not provided
I20260620 14:58:59.998884 27001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:00.002264 27001 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260620 14:59:00.003501 27017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.004212 27001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:59:00.004386 27001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "984ea399c59344f894d89048aeabeb8d"
format_stamp: "Formatted at 2026-06-20 14:58:58 on dist-test-slave-7v06"
server_key: "74c9bee309ac078e5e5e847b5aa08f67"
server_key_iv: "1b4bb40da78f9ceac476e8b8e0b50eba"
server_key_version: "encryptionkey@0"
I20260620 14:59:00.005295 27001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:00.025290 27001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:00.029102 27001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:00.029300 27001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:00.035579 27001 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:39091
I20260620 14:59:00.035908 27069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:39091 every 8 connection(s)
I20260620 14:59:00.036747 27001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:59:00.037652 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27001
I20260620 14:59:00.038076 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:40361
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:39091
--webserver_port=44935
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:00.040117 27070 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:59:00.040956 27070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap starting.
I20260620 14:59:00.051645 27070 log.cc:824] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:00.055200 27070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:00.055656 27070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap complete.
I20260620 14:59:00.060472 27070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.060904 27070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984ea399c59344f894d89048aeabeb8d, State: Initialized, Role: FOLLOWER
I20260620 14:59:00.061122 27070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.061228 27070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:59:00.061300 27070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:59:00.061365 27070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:59:00.062986 27070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.063126 27070 leader_election.cc:302] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 984ea399c59344f894d89048aeabeb8d; no voters:
I20260620 14:59:00.063315 27070 leader_election.cc:288] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 14:59:00.063419 27074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Leader election won for term 2
I20260620 14:59:00.063644 27070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:59:00.063674 27074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 LEADER]: Becoming Leader. State: Replica: 984ea399c59344f894d89048aeabeb8d, State: Running, Role: LEADER
I20260620 14:59:00.063894 27074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.064257 27075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "984ea399c59344f894d89048aeabeb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } } }
I20260620 14:59:00.064375 27075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:00.064556 27076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 984ea399c59344f894d89048aeabeb8d. Latest consensus state: current_term: 2 leader_uuid: "984ea399c59344f894d89048aeabeb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } } }
I20260620 14:59:00.064627 27076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:00.064875 27083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:59:00.065831 27083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:59:00.065994 27083 catalog_manager.cc:1259] Loaded cluster ID: 6138d1ab305640ef826aeac2682e4360
I20260620 14:59:00.066058 27083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:59:00.066452 27083 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260620 14:59:00.070631 27083 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260620 14:59:00.075639 27083 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:59:00.076450 27083 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Loaded TSK: 0
I20260620 14:59:00.076758 27083 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 14:59:00.155210 27072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:00.155470 27072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:00.155501 27072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:00.157372 27072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:00.157449 27072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:00.157485 27072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:59:00.159317 27072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:40361
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=44935
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:00.159651 27072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:00.159976 27072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:00.166576 27097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.166571 27098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.166989 27100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:00.167066 27072 server_base.cc:1034] running on GCE node
I20260620 14:59:00.167326 27072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:00.167699 27072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:00.169062 27072 hybrid_clock.cc:648] HybridClock initialized: now 1781967540169046 us; error 38 us; skew 500 ppm
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:00.174597 27072 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:59:00.176996 27072 webserver.cc:460] Webserver started at http://127.12.116.129:44935/ using document root <none> and password file <none>
I20260620 14:59:00.177385 27072 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:00.177527 27072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:00.179776 27072 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:59:00.180974 27107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.181257 27072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:59:00.181423 27072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "a1ef9af7ecfa46a483bc5311636a250a"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "469567dff31a689c50c950b38dfe650d"
server_key_iv: "f6f59ad0ac14d89e448386844d1e6f91"
server_key_version: "encryptionkey@0"
I20260620 14:59:00.181839 27072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:00.203588 27072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:00.206423 27072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:00.206629 27072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:00.206907 27072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:00.207466 27114 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 14:59:00.209564 27072 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 14:59:00.209666 27072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260620 14:59:00.209791 27072 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 14:59:00.210531 27072 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 14:59:00.210597 27072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260620 14:59:00.210826 27114 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap starting.
I20260620 14:59:00.219982 27072 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40361
I20260620 14:59:00.220583 27072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:59:00.225355 27114 log.cc:824] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:00.226711 27221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40361 every 8 connection(s)
I20260620 14:59:00.227723 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27072
I20260620 14:59:00.228101 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:44251
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:39091
--webserver_port=42397
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:00.230173 27114 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:00.230604 27114 tablet_bootstrap.cc:492] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap complete.
I20260620 14:59:00.231793 27114 ts_tablet_manager.cc:1397] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.014s
I20260620 14:59:00.234149 27114 raft_consensus.cc:348] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:59:00.234601 27114 raft_consensus.cc:729] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ef9af7ecfa46a483bc5311636a250a, State: Initialized, Role: FOLLOWER
I20260620 14:59:00.234789 27114 consensus_queue.cc:260] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } }
I20260620 14:59:00.235147 27114 ts_tablet_manager.cc:1428] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Time spent starting tablet: real 0.003s user 0.005s sys 0.001s
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:00.246243 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.228619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:35645 (local address 127.12.116.190:39091)
0620 14:59:00.228951 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.228965 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.232869 (+ 3904us) server_negotiation.cc:407] Connection header received
0620 14:59:00.233974 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.233983 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.234078 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.234240 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:00.235672 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.236999 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.238426 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.238909 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.239054 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.241919 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:00.241925 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:00.241925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:00.241938 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:00.244168 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.244770 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.244774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.244774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.244913 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.245205 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.245206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.245206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.245468 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:00.245573 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.245886 (+ 313us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.246019 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":116,"threads_started":1}
I20260620 14:59:00.246263 27225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.227947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:35645)
0620 14:59:00.232491 (+ 4544us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.232565 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.233594 (+ 1029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.234403 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.234407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.235185 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:00.235496 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.235503 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.237127 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.237129 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.238260 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.238264 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.239029 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.239031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.239184 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.239819 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:00.239838 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:00.241732 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:00.244320 (+ 2588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:00.244366 (+ 46us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:00.244370 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:00.244669 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:00.245006 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:00.245007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:00.245008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:00.245128 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:00.245549 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:00.245557 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:00.245704 (+ 147us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.245811 (+ 107us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.246019 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4477,"thread_start_us":127,"threads_started":1}
I20260620 14:59:00.247932 27222 heartbeater.cc:347] Connected to a master server at 127.12.116.190:39091
I20260620 14:59:00.248080 27222 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:00.248298 27222 heartbeater.cc:511] Master 127.12.116.190:39091 requested a full tablet report, sending...
I20260620 14:59:00.249125 27034 ts_manager.cc:194] Registered new tserver with Master: a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361)
I20260620 14:59:00.250468 27034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:35645
I20260620 14:59:00.251408 27222 heartbeater.cc:503] Master 127.12.116.190:39091 was elected leader, sending a full tablet report...
I20260620 14:59:00.256033 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.250090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60576 (local address 127.12.116.129:40361)
0620 14:59:00.250295 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.250300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.252627 (+ 2327us) server_negotiation.cc:407] Connection header received
0620 14:59:00.252743 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.252746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.252762 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.252857 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:00.253089 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.253822 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.254926 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.255530 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.255634 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.255698 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.255878 (+ 180us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.255926 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":114,"threads_started":1}
I20260620 14:59:00.256027 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.249804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40361 (local address 127.0.0.1:60576)
0620 14:59:00.252506 (+ 2702us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.252549 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.252650 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.252861 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.252864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.252867 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:00.252945 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.252947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.253937 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.253938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.254814 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.254816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.255634 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.255635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.255735 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.255749 (+ 14us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.255856 (+ 107us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.255926 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2666,"thread_start_us":93,"threads_started":1}
I20260620 14:59:00.257227 27138 tablet_service.cc:1514] Processing DeleteTablet for tablet 56ba6f3dabc643ab86fd822207114ea3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:58:59 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60576
I20260620 14:59:00.258183 27231 tablet_replica.cc:330] stopping tablet replica
I20260620 14:59:00.258347 27231 raft_consensus.cc:2229] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:00.258452 27231 raft_consensus.cc:2258] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:00.258833 27231 ts_tablet_manager.cc:1905] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:00.261744 27231 ts_tablet_manager.cc:1918] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:00.261888 27231 log.cc:1196] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/56ba6f3dabc643ab86fd822207114ea3
I20260620 14:59:00.262177 27231 ts_tablet_manager.cc:1939] T 56ba6f3dabc643ab86fd822207114ea3 P a1ef9af7ecfa46a483bc5311636a250a: Deleting consensus metadata
I20260620 14:59:00.262847 27018 catalog_manager.cc:4841] TS a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361): tablet 56ba6f3dabc643ab86fd822207114ea3 (table test-table [id=50b9c636e00648ed9e1340a1fa893022]) successfully deleted
W20260620 14:59:00.357036 27227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:00.357359 27227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:00.357393 27227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:00.359177 27227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:00.359267 27227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:00.359303 27227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:59:00.361549 27227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:44251
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=42397
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:00.361941 27227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:00.362257 27227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:00.370196 27236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.370180 27239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.371673 27237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:00.371869 27227 server_base.cc:1034] running on GCE node
I20260620 14:59:00.372185 27227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:00.372542 27227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:00.375960 27227 hybrid_clock.cc:648] HybridClock initialized: now 1781967540375851 us; error 102 us; skew 500 ppm
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:00.379778 27227 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:59:00.380456 27227 webserver.cc:460] Webserver started at http://127.12.116.130:42397/ using document root <none> and password file <none>
I20260620 14:59:00.380779 27227 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:00.380897 27227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:00.382879 27227 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:59:00.383826 27246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.384207 27227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:59:00.384388 27227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6ba4f5eaab3a4716aaf6a57864d0b790"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "0e5b49d1eba8b0fd7907a5a94054c116"
server_key_iv: "7d1c6da4dc7a97efbd4a919e608a80f3"
server_key_version: "encryptionkey@0"
I20260620 14:59:00.384859 27227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:00.403267 27227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:00.406409 27227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:00.406617 27227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:00.406920 27227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:00.407311 27227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:00.407459 27227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.407553 27227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:00.407603 27227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.417663 27227 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:44251
I20260620 14:59:00.417847 27359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:44251 every 8 connection(s)
I20260620 14:59:00.418397 27227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:59:00.419690 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27227
I20260620 14:59:00.420190 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:40969
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:39091
--webserver_port=44723
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:00.432227 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.419385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:41065 (local address 127.12.116.190:39091)
0620 14:59:00.419530 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.419533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.419745 (+ 212us) server_negotiation.cc:407] Connection header received
0620 14:59:00.420370 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.420372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.420387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.420444 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:00.421505 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.422041 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.423150 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.423377 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.423491 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.426147 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:00.426149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:00.426149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:00.426158 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:00.430165 (+ 4007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.430808 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.430810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.430810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.430884 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.431198 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.431199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.431199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.431342 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:00.431437 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.431777 (+ 340us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.432100 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260620 14:59:00.432525 27362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.419276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:41065)
0620 14:59:00.419571 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.419630 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.420232 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.420540 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.420543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.421156 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:00.421376 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.421382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.422160 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.422161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.423038 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.423040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.423524 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.423526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.423691 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.424379 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:00.424390 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:00.426016 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:00.430338 (+ 4322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:00.430362 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:00.430365 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:00.430706 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:00.430978 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:00.430979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:00.430980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:00.431119 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:00.431428 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:00.431436 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:00.431602 (+ 166us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.431754 (+ 152us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.432214 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":104,"threads_started":1}
I20260620 14:59:00.433461 27360 heartbeater.cc:347] Connected to a master server at 127.12.116.190:39091
I20260620 14:59:00.433662 27360 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:00.434041 27360 heartbeater.cc:511] Master 127.12.116.190:39091 requested a full tablet report, sending...
I20260620 14:59:00.434732 27034 ts_manager.cc:194] Registered new tserver with Master: 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251)
I20260620 14:59:00.435374 27034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:41065
W20260620 14:59:00.524812 27363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:00.525087 27363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:00.525120 27363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:00.526746 27363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:00.526827 27363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:00.526868 27363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:59:00.528868 27363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:40969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=44723
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:00.529182 27363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:00.529451 27363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:00.535631 27369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.535610 27371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.535586 27368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:00.535807 27363 server_base.cc:1034] running on GCE node
I20260620 14:59:00.536188 27363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:00.536530 27363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:00.537735 27363 hybrid_clock.cc:648] HybridClock initialized: now 1781967540537715 us; error 37 us; skew 500 ppm
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:00.540998 27363 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:59:00.541538 27363 webserver.cc:460] Webserver started at http://127.12.116.131:44723/ using document root <none> and password file <none>
I20260620 14:59:00.541817 27363 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:00.541913 27363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:00.543468 27363 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:00.544483 27378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.544755 27363 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:00.544870 27363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "03b830ad64124be0bd6368c0e1a74737"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "f372e3447e33c1f41bde368da0d1ae72"
server_key_iv: "5c5dc1ec549ee43bd265c9cbc25b627c"
server_key_version: "encryptionkey@0"
I20260620 14:59:00.545288 27363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:00.570904 27363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:00.573511 27363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:00.573676 27363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:00.573939 27363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:00.574276 27363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:00.574331 27363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.574378 27363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:00.574404 27363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.580935 27363 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:40969
I20260620 14:59:00.581056 27491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:40969 every 8 connection(s)
I20260620 14:59:00.581414 27363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:59:00.588817 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27363
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:00.595999 27494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.582197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:41173)
0620 14:59:00.582473 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.582514 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.583087 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.583382 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.583386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.584023 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:00.584242 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.584247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.585028 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.585033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.586151 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.586154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.586782 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.586783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.586948 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.588296 (+ 1348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:00.588307 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:00.591590 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:00.594244 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:00.594255 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:00.594258 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:00.594543 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:00.594794 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:00.594795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:00.594795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:00.594919 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:00.595203 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:00.595211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:00.595421 (+ 210us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.595578 (+ 157us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.595795 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":118,"threads_started":1}
I20260620 14:59:00.595992 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.582307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:41173 (local address 127.12.116.190:39091)
0620 14:59:00.582411 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.582414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.582605 (+ 191us) server_negotiation.cc:407] Connection header received
0620 14:59:00.583206 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.583208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.583220 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.583298 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:00.584392 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.584899 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.586258 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.586475 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.586763 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.591803 (+ 5040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:00.591806 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:00.591807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:00.591830 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:00.594079 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.594649 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.594650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.594651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.594717 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.594998 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.594999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.595000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.595128 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:00.595211 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.595638 (+ 427us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.595868 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260620 14:59:00.596880 27492 heartbeater.cc:347] Connected to a master server at 127.12.116.190:39091
I20260620 14:59:00.597050 27492 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:00.597296 27492 heartbeater.cc:511] Master 127.12.116.190:39091 requested a full tablet report, sending...
I20260620 14:59:00.597846 27034 ts_manager.cc:194] Registered new tserver with Master: 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
I20260620 14:59:00.598709 27034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:41173
I20260620 14:59:00.601490 27496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.589884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35982 (local address 127.12.116.190:39091)
0620 14:59:00.590102 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.590105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.590296 (+ 191us) server_negotiation.cc:407] Connection header received
0620 14:59:00.590350 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.590351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.590366 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.590448 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:00.591914 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.593479 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.594707 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.594947 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.595033 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.597153 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:00.597155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:00.597155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:00.597166 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:00.599328 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.599789 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.599790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.599791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.599877 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:00.600601 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:00.600603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:00.600603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:00.600730 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:00.600921 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.601254 (+ 333us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.601389 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":117,"threads_started":1}
I20260620 14:59:00.603242 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:59:00.607187 27496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.603891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34890 (local address 127.12.116.190:39091)
0620 14:59:00.603997 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.603999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.604029 (+ 30us) server_negotiation.cc:407] Connection header received
0620 14:59:00.604114 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.604115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.604153 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.604237 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:59:00.604546 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.605174 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.606139 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.606421 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.606519 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.606787 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:59:00.606914 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:59:00.606992 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.607059 (+ 67us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.607110 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260620 14:59:00.607642 27034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:59:00.609901 27034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:59:00.614238 27138 tablet_service.cc:1467] Processing CreateTablet for tablet 41f759d940694204951ac8744cf9305e (DEFAULT_TABLE table=test-table [id=da15b12124c044d590f26500b7cbdc85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:00.614528 27138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f759d940694204951ac8744cf9305e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:00.616360 27114 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap starting.
I20260620 14:59:00.616825 27114 tablet_bootstrap.cc:654] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:00.618489 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.614156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54110 (local address 127.12.116.131:40969)
0620 14:59:00.614360 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.614364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.614376 (+ 12us) server_negotiation.cc:407] Connection header received
0620 14:59:00.614424 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.614426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.614444 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.614542 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:00.614694 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.615780 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.617312 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.618038 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.618160 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.618230 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.618338 (+ 108us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.618394 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":109,"threads_started":1}
I20260620 14:59:00.618506 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.613489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40969 (local address 127.0.0.1:54110)
0620 14:59:00.613649 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.613662 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.613738 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.614545 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.614546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.614548 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:00.614617 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.614620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.615917 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.615918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.617119 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.617122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.618158 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.618159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.618225 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.618229 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.618293 (+ 64us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.618356 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":16}
I20260620 14:59:00.618875 27114 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: No bootstrap required, opened a new log
I20260620 14:59:00.618942 27114 ts_tablet_manager.cc:1397] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260620 14:59:00.619242 27114 raft_consensus.cc:348] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.619272 27501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.613835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43918 (local address 127.12.116.130:44251)
0620 14:59:00.614106 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.614111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.614987 (+ 876us) server_negotiation.cc:407] Connection header received
0620 14:59:00.615119 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.615122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.615139 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.615198 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:00.615439 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.616405 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.617893 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.618516 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.618596 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.618653 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.618875 (+ 222us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.618933 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":147,"threads_started":1}
I20260620 14:59:00.619372 27114 raft_consensus.cc:374] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:00.619469 27114 raft_consensus.cc:729] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ef9af7ecfa46a483bc5311636a250a, State: Initialized, Role: FOLLOWER
I20260620 14:59:00.619535 27114 consensus_queue.cc:260] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.619712 27114 ts_tablet_manager.cc:1428] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 14:59:00.619886 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.614374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44251 (local address 127.0.0.1:43918)
0620 14:59:00.614846 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.614932 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.615019 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.615306 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.615307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.615309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:00.615346 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.615348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.616628 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.616629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.617807 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.617810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.618693 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.618694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.618761 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.618765 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.619501 (+ 736us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.619614 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":93,"threads_started":1}
I20260620 14:59:00.620378 27426 tablet_service.cc:1467] Processing CreateTablet for tablet 41f759d940694204951ac8744cf9305e (DEFAULT_TABLE table=test-table [id=da15b12124c044d590f26500b7cbdc85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:00.620836 27426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f759d940694204951ac8744cf9305e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:00.623914 27505 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Bootstrap starting.
I20260620 14:59:00.624426 27294 tablet_service.cc:1467] Processing CreateTablet for tablet 41f759d940694204951ac8744cf9305e (DEFAULT_TABLE table=test-table [id=da15b12124c044d590f26500b7cbdc85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:00.624814 27505 tablet_bootstrap.cc:654] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:00.624876 27294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f759d940694204951ac8744cf9305e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:00.625382 27505 log.cc:824] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:00.626286 27505 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: No bootstrap required, opened a new log
I20260620 14:59:00.626385 27505 ts_tablet_manager.cc:1397] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:59:00.628237 27507 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Bootstrap starting.
I20260620 14:59:00.628166 27505 raft_consensus.cc:348] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.628334 27505 raft_consensus.cc:374] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:00.628403 27505 raft_consensus.cc:729] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03b830ad64124be0bd6368c0e1a74737, State: Initialized, Role: FOLLOWER
I20260620 14:59:00.628530 27505 consensus_queue.cc:260] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.628875 27505 ts_tablet_manager.cc:1428] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 14:59:00.628907 27492 heartbeater.cc:503] Master 127.12.116.190:39091 was elected leader, sending a full tablet report...
I20260620 14:59:00.629012 27507 tablet_bootstrap.cc:654] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:00.629634 27507 log.cc:824] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:00.630538 27507 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: No bootstrap required, opened a new log
I20260620 14:59:00.630602 27507 ts_tablet_manager.cc:1397] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:59:00.632287 27507 raft_consensus.cc:348] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.632560 27507 raft_consensus.cc:374] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:00.632592 27507 raft_consensus.cc:729] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba4f5eaab3a4716aaf6a57864d0b790, State: Initialized, Role: FOLLOWER
I20260620 14:59:00.632728 27507 consensus_queue.cc:260] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.633047 27507 ts_tablet_manager.cc:1428] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:59:00.633200 27360 heartbeater.cc:503] Master 127.12.116.190:39091 was elected leader, sending a full tablet report...
W20260620 14:59:00.669225 27361 tablet.cc:2369] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:59:00.702104 27510 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:00.702275 27510 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.702986 27510 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969), a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361)
I20260620 14:59:00.707054 27362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.703207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40969 (local address 127.12.116.130:46681)
0620 14:59:00.703425 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.703443 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.703537 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.703816 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.703818 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.703823 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:00.703948 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.703963 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.704935 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.704937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.705937 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.705940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.706701 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.706702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.706804 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.706809 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.706893 (+ 84us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.706944 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260620 14:59:00.707098 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.703297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:46681 (local address 127.12.116.131:40969)
0620 14:59:00.703367 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.703370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.703534 (+ 164us) server_negotiation.cc:407] Connection header received
0620 14:59:00.703602 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.703604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.703615 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.703693 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:00.704088 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.704813 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.706052 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.706584 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.706655 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.706664 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.706905 (+ 241us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.706980 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 14:59:00.707404 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.703536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:40321 (local address 127.12.116.129:40361)
0620 14:59:00.703601 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.703603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.703788 (+ 185us) server_negotiation.cc:407] Connection header received
0620 14:59:00.703842 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.703844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.703860 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.703975 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:00.704477 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.705161 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.706389 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.706960 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.707077 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.707089 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.707281 (+ 192us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.707336 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 14:59:00.707578 27446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41f759d940694204951ac8744cf9305e" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03b830ad64124be0bd6368c0e1a74737" is_pre_election: true
I20260620 14:59:00.707664 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.703452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40361 (local address 127.12.116.130:40321)
0620 14:59:00.703673 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.703682 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:00.703735 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:00.704185 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:00.704187 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:00.704191 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:00.704292 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.704295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.705298 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.705299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.706189 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:00.706191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.707084 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.707086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:00.707175 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.707180 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:59:00.707517 (+ 337us) client_negotiation.cc:240] Negotiation successful
0620 14:59:00.707572 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":123,"threads_started":1}
I20260620 14:59:00.707804 27446 raft_consensus.cc:2454] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 0.
I20260620 14:59:00.708158 27249 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790; no voters:
I20260620 14:59:00.708401 27510 raft_consensus.cc:2781] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:59:00.708480 27510 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:59:00.708519 27510 raft_consensus.cc:3037] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:00.708416 27176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41f759d940694204951ac8744cf9305e" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ef9af7ecfa46a483bc5311636a250a" is_pre_election: true
I20260620 14:59:00.708647 27176 raft_consensus.cc:2454] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 0.
I20260620 14:59:00.709537 27510 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.709717 27510 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 election: Requested vote from peers 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969), a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361)
I20260620 14:59:00.709928 27176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41f759d940694204951ac8744cf9305e" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ef9af7ecfa46a483bc5311636a250a"
I20260620 14:59:00.710003 27446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41f759d940694204951ac8744cf9305e" candidate_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03b830ad64124be0bd6368c0e1a74737"
I20260620 14:59:00.710038 27176 raft_consensus.cc:3037] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:00.710096 27446 raft_consensus.cc:3037] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:00.711184 27446 raft_consensus.cc:2454] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 1.
I20260620 14:59:00.711514 27249 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790; no voters:
I20260620 14:59:00.711578 27176 raft_consensus.cc:2454] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba4f5eaab3a4716aaf6a57864d0b790 in term 1.
I20260620 14:59:00.711711 27510 raft_consensus.cc:2781] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:59:00.712002 27510 raft_consensus.cc:686] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 LEADER]: Becoming Leader. State: Replica: 6ba4f5eaab3a4716aaf6a57864d0b790, State: Running, Role: LEADER
I20260620 14:59:00.712285 27510 consensus_queue.cc:237] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:00.713917 27034 catalog_manager.cc:5495] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } health_report { overall_health: UNKNOWN } } }
W20260620 14:59:00.727826 27223 tablet.cc:2369] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:59:00.742178 27501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.739117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43926 (local address 127.12.116.130:44251)
0620 14:59:00.739212 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:00.739214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:00.739223 (+ 9us) server_negotiation.cc:407] Connection header received
0620 14:59:00.739263 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:00.739264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:00.739285 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:00.739360 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:59:00.739498 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.740011 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.741063 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:00.741349 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:00.741470 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:00.741705 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:59:00.741894 (+ 189us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:59:00.741988 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:00.742025 (+ 37us) server_negotiation.cc:299] Negotiation successful
0620 14:59:00.742055 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260620 14:59:00.744529 27446 raft_consensus.cc:1261] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Refusing update from remote peer 6ba4f5eaab3a4716aaf6a57864d0b790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:59:00.744556 27176 raft_consensus.cc:1261] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Refusing update from remote peer 6ba4f5eaab3a4716aaf6a57864d0b790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:59:00.744990 27512 consensus_queue.cc:1035] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:59:00.745139 27510 consensus_queue.cc:1035] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:59:00.747942 27515 mvcc.cc:205] Tried to move back new op lower bound from 7298939046885445632 to 7298939046758817792. Current Snapshot: MvccSnapshot[applied={T|T < 7298939046885445632}]
I20260620 14:59:00.748488 27514 mvcc.cc:205] Tried to move back new op lower bound from 7298939046885445632 to 7298939046758817792. Current Snapshot: MvccSnapshot[applied={T|T < 7298939046885445632}]
I20260620 14:59:00.751294 27034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:59:00.751451 27034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:59:00.752823 27034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Sending DeleteTablet for 3 replicas of tablet 41f759d940694204951ac8744cf9305e
I20260620 14:59:00.753233 27294 tablet_service.cc:1514] Processing DeleteTablet for tablet 41f759d940694204951ac8744cf9305e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:00 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:43918
I20260620 14:59:00.753392 27138 tablet_service.cc:1514] Processing DeleteTablet for tablet 41f759d940694204951ac8744cf9305e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:00 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60576
I20260620 14:59:00.753508 27231 tablet_replica.cc:330] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: stopping tablet replica
I20260620 14:59:00.753496 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27072
I20260620 14:59:00.753558 27231 raft_consensus.cc:2229] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:00.753613 27231 raft_consensus.cc:2258] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:00.753573 27426 tablet_service.cc:1514] Processing DeleteTablet for tablet 41f759d940694204951ac8744cf9305e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:00 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54110
I20260620 14:59:00.753974 27524 tablet_replica.cc:330] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: stopping tablet replica
I20260620 14:59:00.754108 27525 tablet_replica.cc:330] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: stopping tablet replica
I20260620 14:59:00.754261 27525 raft_consensus.cc:2229] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:00.754411 27524 raft_consensus.cc:2229] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:59:00.754603 27525 raft_consensus.cc:2258] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:00.754796 27524 raft_consensus.cc:2258] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:00.755561 27524 ts_tablet_manager.cc:1905] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:00.755926 27525 ts_tablet_manager.cc:1905] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:00.757995 27525 ts_tablet_manager.cc:1918] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:00.760011 27524 ts_tablet_manager.cc:1918] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:00.760246 27524 log.cc:1196] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/41f759d940694204951ac8744cf9305e
W20260620 14:59:00.760311 27018 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:40361 (error 108)
I20260620 14:59:00.760947 27524 ts_tablet_manager.cc:1939] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting consensus metadata
I20260620 14:59:00.760939 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27227
I20260620 14:59:00.761816 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.761164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40361 (local address 127.0.0.1:46270)
0620 14:59:00.761700 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.761758 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468}
I20260620 14:59:00.760464 27525 log.cc:1196] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/41f759d940694204951ac8744cf9305e
I20260620 14:59:00.762725 27525 ts_tablet_manager.cc:1939] T 41f759d940694204951ac8744cf9305e P 03b830ad64124be0bd6368c0e1a74737: Deleting consensus metadata
W20260620 14:59:00.762282 27018 catalog_manager.cc:4584] TS a1ef9af7ecfa46a483bc5311636a250a (127.12.116.129:40361): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 41f759d940694204951ac8744cf9305e: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40361: connect: Connection refused (error 111)
I20260620 14:59:00.763379 27020 catalog_manager.cc:4841] TS 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): tablet 41f759d940694204951ac8744cf9305e (table test-table [id=da15b12124c044d590f26500b7cbdc85]) successfully deleted
I20260620 14:59:00.768199 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27363
I20260620 14:59:00.768428 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:00.768232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44251 (local address 127.0.0.1:43934)
0620 14:59:00.768298 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:00.768375 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.130:44251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 14:59:00.773479 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27001
I20260620 14:59:00.780079 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:39091
--webserver_interface=127.12.116.190
--webserver_port=43673
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:39091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:00.873718 27527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:00.874076 27527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:00.874126 27527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:00.875717 27527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:59:00.875804 27527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:00.875831 27527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:00.875856 27527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:59:00.875959 27527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:59:00.877967 27527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:39091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:39091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=43673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:00.878324 27527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:00.878600 27527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:00.885421 27535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.885412 27533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:00.885412 27532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:00.885455 27527 server_base.cc:1034] running on GCE node
I20260620 14:59:00.886029 27527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:00.886332 27527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:00.887513 27527 hybrid_clock.cc:648] HybridClock initialized: now 1781967540887495 us; error 42 us; skew 500 ppm
Jun 20 14:59:00 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967540, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:00.890837 27527 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:59:00.891449 27527 webserver.cc:460] Webserver started at http://127.12.116.190:43673/ using document root <none> and password file <none>
I20260620 14:59:00.891713 27527 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:00.891789 27527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:00.893800 27527 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:00.895035 27542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:00.895572 27527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:00.895694 27527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "984ea399c59344f894d89048aeabeb8d"
format_stamp: "Formatted at 2026-06-20 14:58:58 on dist-test-slave-7v06"
server_key: "74c9bee309ac078e5e5e847b5aa08f67"
server_key_iv: "1b4bb40da78f9ceac476e8b8e0b50eba"
server_key_version: "encryptionkey@0"
I20260620 14:59:00.896134 27527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:00.913165 27527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:00.917253 27527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:00.917407 27527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:00.923513 27527 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:39091
I20260620 14:59:00.923638 27594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:39091 every 8 connection(s)
I20260620 14:59:00.924301 27527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:59:00.926550 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27527
I20260620 14:59:00.926563 27595 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:59:00.926930 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:40361
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:39091
--webserver_port=44935
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:00.927775 27595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap starting.
I20260620 14:59:00.937978 27595 log.cc:824] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:00.940871 27595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:00.941280 27595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d: Bootstrap complete.
I20260620 14:59:00.945793 27595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.946595 27595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984ea399c59344f894d89048aeabeb8d, State: Initialized, Role: FOLLOWER
I20260620 14:59:00.946873 27595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.946969 27595 raft_consensus.cc:388] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:59:00.947055 27595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:59:00.947343 27595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:59:00.948938 27595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.949119 27595 leader_election.cc:302] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 984ea399c59344f894d89048aeabeb8d; no voters:
I20260620 14:59:00.949395 27595 leader_election.cc:288] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [CANDIDATE]: Term 3 election: Requested vote from peers
I20260620 14:59:00.949440 27599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 3 FOLLOWER]: Leader election won for term 3
I20260620 14:59:00.949561 27599 raft_consensus.cc:686] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [term 3 LEADER]: Becoming Leader. State: Replica: 984ea399c59344f894d89048aeabeb8d, State: Running, Role: LEADER
I20260620 14:59:00.949676 27599 consensus_queue.cc:237] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } }
I20260620 14:59:00.949712 27595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:59:00.950038 27601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 984ea399c59344f894d89048aeabeb8d. Latest consensus state: current_term: 3 leader_uuid: "984ea399c59344f894d89048aeabeb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } } }
I20260620 14:59:00.950145 27600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "984ea399c59344f894d89048aeabeb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "984ea399c59344f894d89048aeabeb8d" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 39091 } } }
I20260620 14:59:00.950320 27600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:00.950273 27601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 984ea399c59344f894d89048aeabeb8d [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:00.950718 27604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:59:00.952059 27604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:59:00.952220 27604 catalog_manager.cc:1259] Loaded cluster ID: 6138d1ab305640ef826aeac2682e4360
I20260620 14:59:00.952446 27604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260620 14:59:00.952731 27604 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbdebd3c9ad google::LogMessage::Fail() at ??:0
@ 0x7fbdebd3f88a google::LogMessage::SendToLog() at ??:0
@ 0x7fbdebd3c4de google::LogMessage::Flush() at ??:0
@ 0x7fbdebd3da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbdf3c5d0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fbdf3c668b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbdedc0a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbdedbff954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbdeea636db start_thread at ??:0
@ 0x7fbdea83a61f clone at ??:0
W20260620 14:59:01.071782 27597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:01.072088 27597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:01.072121 27597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:01.074316 27597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:01.074404 27597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:01.074456 27597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:59:01.077382 27597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:40361
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=44935
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:01.077764 27597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:01.078059 27597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:01.085717 27632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:01.085695 27631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:01.085668 27634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:01.086110 27597 server_base.cc:1034] running on GCE node
I20260620 14:59:01.086349 27597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:01.086658 27597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:01.087930 27597 hybrid_clock.cc:648] HybridClock initialized: now 1781967541087895 us; error 55 us; skew 500 ppm
Jun 20 14:59:01 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967541, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:01.091231 27597 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:59:01.091881 27597 webserver.cc:460] Webserver started at http://127.12.116.129:44935/ using document root <none> and password file <none>
I20260620 14:59:01.092155 27597 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:01.092211 27597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:01.093894 27597 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:01.094743 27641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:01.095016 27597 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:01.095140 27597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "a1ef9af7ecfa46a483bc5311636a250a"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "469567dff31a689c50c950b38dfe650d"
server_key_iv: "f6f59ad0ac14d89e448386844d1e6f91"
server_key_version: "encryptionkey@0"
I20260620 14:59:01.095640 27597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:01.144158 27597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:01.148540 27597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:01.148746 27597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:01.149048 27597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:01.149643 27648 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 14:59:01.152405 27597 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 14:59:01.152576 27597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260620 14:59:01.152694 27597 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 14:59:01.153765 27597 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 14:59:01.153890 27648 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap starting.
I20260620 14:59:01.153923 27597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:01.163631 27597 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40361
I20260620 14:59:01.163702 27755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40361 every 8 connection(s)
I20260620 14:59:01.164587 27597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:59:01.165946 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27597
I20260620 14:59:01.166384 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:44251
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:39091
--webserver_port=42397
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:01.167725 27648 log.cc:824] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:01.172392 27648 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:01.172832 27648 tablet_bootstrap.cc:492] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Bootstrap complete.
I20260620 14:59:01.174293 27648 ts_tablet_manager.cc:1397] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.011s
I20260620 14:59:01.176541 27648 raft_consensus.cc:348] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:01.177037 27648 raft_consensus.cc:729] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ef9af7ecfa46a483bc5311636a250a, State: Initialized, Role: FOLLOWER
I20260620 14:59:01.177219 27648 consensus_queue.cc:260] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:01.178077 27648 ts_tablet_manager.cc:1428] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260620 14:59:01.265587 27760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:01.265838 27760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:01.265867 27760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:01.267369 27760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:01.267460 27760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:01.267495 27760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:59:01.270037 27760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:44251
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=42397
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:01.270612 27760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:01.270965 27760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:01.277267 27767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:01.277299 27758 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:59:01.166408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:51309)
0620 14:59:01.167240 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.167302 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:01.168040 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:01.276973 (+108933us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":759,"thread_start_us":131,"threads_started":1}
W20260620 14:59:01.277225 27766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:01.277297 27769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:01.277500 27760 server_base.cc:1034] running on GCE node
W20260620 14:59:01.277649 27756 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:39091 (0 consecutive failures): Network error: Failed to ping master at 127.12.116.190:39091: Client connection negotiation failed: client connection to 127.12.116.190:39091: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 14:59:01.277794 27760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:01.278023 27758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.277916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:48505)
0620 14:59:01.277955 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.277991 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260620 14:59:01.278124 27760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:01.278352 27758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.278247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:47167)
0620 14:59:01.278288 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.278324 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260620 14:59:01.278494 27756 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 14:59:01.279425 27760 hybrid_clock.cc:648] HybridClock initialized: now 1781967541279384 us; error 30 us; skew 500 ppm
Jun 20 14:59:01 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967541, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:01.284525 27760 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:59:01.285192 27760 webserver.cc:460] Webserver started at http://127.12.116.130:42397/ using document root <none> and password file <none>
I20260620 14:59:01.285488 27760 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:01.285550 27760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:01.287144 27760 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:59:01.288038 27776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:01.288463 27760 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:01.288610 27760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6ba4f5eaab3a4716aaf6a57864d0b790"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "0e5b49d1eba8b0fd7907a5a94054c116"
server_key_iv: "7d1c6da4dc7a97efbd4a919e608a80f3"
server_key_version: "encryptionkey@0"
I20260620 14:59:01.289049 27760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:01.305997 27760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:01.309558 27760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:01.309836 27760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:01.310165 27760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:01.310655 27783 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260620 14:59:01.312207 27783 ts_tablet_manager.cc:1852] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260620 14:59:01.312602 27783 ts_tablet_manager.cc:1905] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:01.315054 27783 ts_tablet_manager.cc:1918] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:01.315230 27783 ts_tablet_manager.cc:1939] T 41f759d940694204951ac8744cf9305e P 6ba4f5eaab3a4716aaf6a57864d0b790: Deleting consensus metadata
I20260620 14:59:01.315514 27760 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260620 14:59:01.315596 27760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260620 14:59:01.315642 27760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:01.315656 27760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:01.323652 27760 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:44251
I20260620 14:59:01.323781 27890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:44251 every 8 connection(s)
I20260620 14:59:01.324141 27760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:59:01.324627 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27760
I20260620 14:59:01.324939 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:40969
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:39091
--webserver_port=44723
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:01.325888 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.325355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:45867)
0620 14:59:01.325584 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.325674 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":109,"threads_started":1}
W20260620 14:59:01.327415 27891 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:39091 (0 consecutive failures): Network error: Failed to ping master at 127.12.116.190:39091: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
I20260620 14:59:01.327865 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.327697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:52725)
0620 14:59:01.327762 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.327814 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 14:59:01.328401 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.328227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:53981)
0620 14:59:01.328294 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.328376 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260620 14:59:01.328532 27891 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 14:59:01.419771 27894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:01.420104 27894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:01.420153 27894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:01.421868 27894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:01.421962 27894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:01.422019 27894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:59:01.423964 27894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:40969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=44723
--tserver_master_addrs=127.12.116.190:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:01.424348 27894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:01.424656 27894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:01.431478 27902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:01.431710 27899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:01.431830 27900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:01.431922 27894 server_base.cc:1034] running on GCE node
I20260620 14:59:01.432431 27894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:01.432768 27894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:01.434089 27894 hybrid_clock.cc:648] HybridClock initialized: now 1781967541434037 us; error 68 us; skew 500 ppm
Jun 20 14:59:01 dist-test-slave-7v06 krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967541, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:01.437705 27894 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:59:01.438556 27894 webserver.cc:460] Webserver started at http://127.12.116.131:44723/ using document root <none> and password file <none>
I20260620 14:59:01.438901 27894 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:01.439009 27894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:01.441458 27894 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:59:01.442579 27909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:01.442986 27894 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:01.443219 27894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "03b830ad64124be0bd6368c0e1a74737"
format_stamp: "Formatted at 2026-06-20 14:58:59 on dist-test-slave-7v06"
server_key: "f372e3447e33c1f41bde368da0d1ae72"
server_key_iv: "5c5dc1ec549ee43bd265c9cbc25b627c"
server_key_version: "encryptionkey@0"
I20260620 14:59:01.443727 27894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:01.467445 27894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:01.470520 27894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:01.470739 27894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:01.471036 27894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:01.471424 27894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:01.471472 27894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:01.471510 27894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:01.471529 27894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:01.479091 27894 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:40969
I20260620 14:59:01.479285 28022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:40969 every 8 connection(s)
I20260620 14:59:01.479640 27894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:59:01.481648 28025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.481048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:50171)
0620 14:59:01.481317 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.481445 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":127,"threads_started":1}
W20260620 14:59:01.482386 28023 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:39091 (0 consecutive failures): Network error: Failed to ping master at 127.12.116.190:39091: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
I20260620 14:59:01.482879 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 27894
I20260620 14:59:01.482915 28025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.482747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:53503)
0620 14:59:01.482839 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.482882 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260620 14:59:01.483321 28025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:01.483217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:39643)
0620 14:59:01.483264 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:01.483289 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 14:59:01.483497 28023 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 14:59:02.279301 28027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.279060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:44443)
0620 14:59:02.279192 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:02.279236 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260620 14:59:02.329546 28028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.329106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:48629)
0620 14:59:02.329362 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:02.329442 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":79,"threads_started":1}
I20260620 14:59:02.484269 28029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.483952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:59281)
0620 14:59:02.484152 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:02.484199 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
I20260620 14:59:02.924461 28030 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:02.924623 28030 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:02.925169 28030 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
Jun 20 14:59:02 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967541, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.131@KRBTEST.COM
Jun 20 14:59:02 dist-test-slave-7v06 krb5kdc[26452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967541, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.130@KRBTEST.COM
I20260620 14:59:02.937842 28032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.925505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:40969 (local address 127.12.116.129:39729)
0620 14:59:02.925710 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:02.925723 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:02.925790 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:02.926756 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:02.926759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:02.927218 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:02.927452 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:02.927460 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.928852 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.928853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:02.929699 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:02.929702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.930409 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.930410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:02.930533 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:02.931293 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:02.931304 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:02.933235 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:02.935837 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:02.935853 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:02.935856 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:02.936228 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:02.936578 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:02.936579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:02.936579 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:02.936727 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:02.937207 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:02.937214 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:02.937358 (+ 144us) client_negotiation.cc:769] Sending connection context
0620 14:59:02.937477 (+ 119us) client_negotiation.cc:240] Negotiation successful
0620 14:59:02.937718 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":5,"thread_start_us":125,"threads_started":1}
I20260620 14:59:02.937848 28033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.925626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:35177 (local address 127.12.116.130:44251)
0620 14:59:02.925843 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:02.925857 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:02.925885 (+ 28us) server_negotiation.cc:407] Connection header received
0620 14:59:02.926454 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:02.926457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:02.926519 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:02.926704 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:02.927605 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.928622 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.929808 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.930270 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.930417 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:02.933797 (+ 3380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:02.933802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:02.933802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:02.933814 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:02.935757 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:02.936360 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:02.936365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:02.936366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:02.936493 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:02.936804 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:02.936805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:02.936806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:02.937122 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:02.937226 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:02.937540 (+ 314us) server_negotiation.cc:299] Negotiation successful
0620 14:59:02.937700 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260620 14:59:02.937842 28034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.925738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:39729 (local address 127.12.116.131:40969)
0620 14:59:02.925942 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:02.925951 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:02.925979 (+ 28us) server_negotiation.cc:407] Connection header received
0620 14:59:02.926474 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:02.926477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:02.926521 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:02.926708 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:02.927618 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.928736 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.929819 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.930291 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.930444 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:02.933502 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:02.933508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:02.933509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:02.933533 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:02.935691 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:02.936362 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:02.936366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:02.936366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:02.936495 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:02.936808 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:02.936809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:02.936809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:02.937122 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:02.937226 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:02.937547 (+ 321us) server_negotiation.cc:299] Negotiation successful
0620 14:59:02.937705 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":69,"threads_started":1}
I20260620 14:59:02.938616 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:02.925464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:44251 (local address 127.12.116.129:35177)
0620 14:59:02.925616 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:02.925631 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:02.925703 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:02.926755 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:02.926759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:02.927211 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:02.927452 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:02.927460 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.928759 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.928760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:02.929700 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:02.929703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:02.930382 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:02.930383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:02.930536 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:02.931296 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:02.931307 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:02.933648 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:02.935928 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:02.935929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:02.935929 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:02.936212 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:02.936581 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:02.936582 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:02.936582 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:02.936727 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:02.937212 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:02.937219 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:02.937358 (+ 139us) client_negotiation.cc:769] Sending connection context
0620 14:59:02.937476 (+ 118us) client_negotiation.cc:240] Negotiation successful
0620 14:59:02.937808 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":214,"thread_start_us":89,"threads_started":1}
W20260620 14:59:02.938850 27644 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
W20260620 14:59:02.939551 27645 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
I20260620 14:59:02.939612 27645 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ef9af7ecfa46a483bc5311636a250a; no voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790
I20260620 14:59:02.939796 28030 raft_consensus.cc:2726] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:59:03.280027 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:03.279859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:46437)
0620 14:59:03.279930 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:03.279978 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260620 14:59:03.330799 28035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:03.330494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:43481)
0620 14:59:03.330691 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:03.330749 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":97,"threads_started":1}
I20260620 14:59:03.485181 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:03.484909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:39607)
0620 14:59:03.485078 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:03.485130 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":70,"threads_started":1}
I20260620 14:59:04.281334 28037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:04.281009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:33971)
0620 14:59:04.281187 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:04.281257 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":98,"threads_started":1}
I20260620 14:59:04.332418 28038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:04.331718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:52333)
0620 14:59:04.332217 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:04.332294 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":344,"threads_started":1}
I20260620 14:59:04.486450 28039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:04.485988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:39655)
0620 14:59:04.486238 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:04.486322 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":112,"threads_started":1}
I20260620 14:59:05.091986 28040 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:05.092167 28040 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:05.092446 28040 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
W20260620 14:59:05.092886 27645 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
W20260620 14:59:05.093034 27644 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
I20260620 14:59:05.093145 27644 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ef9af7ecfa46a483bc5311636a250a; no voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790
I20260620 14:59:05.093272 28040 raft_consensus.cc:2726] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:59:05.282267 28041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:05.281999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:57343)
0620 14:59:05.282159 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:05.282214 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260620 14:59:05.333667 28042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:05.333239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:44789)
0620 14:59:05.333571 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:05.333614 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":77,"threads_started":1}
I20260620 14:59:05.487726 28043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:05.487265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:51675)
0620 14:59:05.487579 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:05.487637 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":74,"threads_started":1}
I20260620 14:59:06.283330 28044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:06.283067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:53203)
0620 14:59:06.283237 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:06.283281 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":66,"threads_started":1}
I20260620 14:59:06.334798 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:06.334537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:43095)
0620 14:59:06.334692 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:06.334745 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260620 14:59:06.489508 28046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:06.488970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:32791)
0620 14:59:06.489364 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:06.489431 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":284,"threads_started":1}
I20260620 14:59:07.284199 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:07.283920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:41825)
0620 14:59:07.284106 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:07.284149 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":75,"threads_started":1}
I20260620 14:59:07.336187 28048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:07.335813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:35543)
0620 14:59:07.336080 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:07.336134 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":198,"threads_started":1}
I20260620 14:59:07.490549 28049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:07.490239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:57823)
0620 14:59:07.490446 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:07.490495 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":80,"threads_started":1}
I20260620 14:59:07.713151 28050 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:07.713259 28050 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:07.713462 28050 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
W20260620 14:59:07.713886 27645 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
W20260620 14:59:07.714007 27644 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
I20260620 14:59:07.714102 27644 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ef9af7ecfa46a483bc5311636a250a; no voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790
I20260620 14:59:07.714200 28050 raft_consensus.cc:2726] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:59:08.285239 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:08.284926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:35687)
0620 14:59:08.285135 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:08.285187 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":81,"threads_started":1}
I20260620 14:59:08.337208 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:08.336804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:32961)
0620 14:59:08.337034 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:08.337095 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":94,"threads_started":1}
I20260620 14:59:08.491726 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:08.491344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:45809)
0620 14:59:08.491597 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:08.491671 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":110,"threads_started":1}
I20260620 14:59:09.286538 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:09.286204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:44159)
0620 14:59:09.286405 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:09.286486 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":79,"threads_started":1}
I20260620 14:59:09.338294 28055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:09.338030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:49995)
0620 14:59:09.338188 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:09.338239 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260620 14:59:09.493048 28056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:09.492666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:42011)
0620 14:59:09.492911 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:09.492973 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":122,"threads_started":1}
I20260620 14:59:09.631157 28057 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:09.631361 28057 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:09.631644 28057 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
W20260620 14:59:09.632256 27644 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
W20260620 14:59:09.632450 27645 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
I20260620 14:59:09.632526 27645 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ef9af7ecfa46a483bc5311636a250a; no voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790
I20260620 14:59:09.632669 28057 raft_consensus.cc:2726] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:59:10.287642 28058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:10.287290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:47653)
0620 14:59:10.287538 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:10.287593 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":177,"threads_started":1}
I20260620 14:59:10.339308 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:10.338967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:33605)
0620 14:59:10.339198 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:10.339258 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":110,"threads_started":1}
I20260620 14:59:10.494274 28060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:10.493819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:43659)
0620 14:59:10.494062 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:10.494126 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":121,"threads_started":1}
I20260620 14:59:11.155383 28061 raft_consensus.cc:482] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:11.155509 28061 raft_consensus.cc:504] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba4f5eaab3a4716aaf6a57864d0b790" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 44251 } } peers { permanent_uuid: "03b830ad64124be0bd6368c0e1a74737" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 40969 } } peers { permanent_uuid: "a1ef9af7ecfa46a483bc5311636a250a" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40361 } }
I20260620 14:59:11.155733 28061 leader_election.cc:288] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251), 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969)
W20260620 14:59:11.156225 27644 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03b830ad64124be0bd6368c0e1a74737 (127.12.116.131:40969): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
W20260620 14:59:11.156517 27645 leader_election.cc:341] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ba4f5eaab3a4716aaf6a57864d0b790 (127.12.116.130:44251): Not found: Tablet not found: 41f759d940694204951ac8744cf9305e
I20260620 14:59:11.156603 27645 leader_election.cc:302] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ef9af7ecfa46a483bc5311636a250a; no voters: 03b830ad64124be0bd6368c0e1a74737, 6ba4f5eaab3a4716aaf6a57864d0b790
I20260620 14:59:11.156679 28061 raft_consensus.cc:2726] T 41f759d940694204951ac8744cf9305e P a1ef9af7ecfa46a483bc5311636a250a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:59:11.288582 28062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:11.288294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:45539)
0620 14:59:11.288499 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:11.288535 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":134,"threads_started":1}
I20260620 14:59:11.340443 28063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:11.340064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:36763)
0620 14:59:11.340297 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:11.340389 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":80,"threads_started":1}
I20260620 14:59:11.495229 28064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:11.494920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:53785)
0620 14:59:11.495105 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:11.495162 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":76,"threads_started":1}
I20260620 14:59:12.290045 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:12.289460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:54615)
0620 14:59:12.289778 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:12.289860 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":83,"threads_started":1}
I20260620 14:59:12.341380 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:12.341134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:43961)
0620 14:59:12.341282 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:12.341330 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260620 14:59:12.496838 28067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:12.495868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:36735)
0620 14:59:12.496562 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:12.496637 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":280,"threads_started":1}
I20260620 14:59:13.291026 28068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:13.290703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:40835)
0620 14:59:13.290900 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:13.290978 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":72,"threads_started":1}
I20260620 14:59:13.342288 28069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:13.342039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:36433)
0620 14:59:13.342186 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:13.342235 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260620 14:59:13.497888 28070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:13.497593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:54393)
0620 14:59:13.497780 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:13.497831 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
I20260620 14:59:14.291954 28071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:14.291662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:52647)
0620 14:59:14.291862 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:14.291897 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":93,"threads_started":1}
I20260620 14:59:14.343266 28072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:14.342991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:49505)
0620 14:59:14.343161 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:14.343214 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
I20260620 14:59:14.499125 28073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:14.498646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:55563)
0620 14:59:14.498989 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:14.499044 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":254,"threads_started":1}
I20260620 14:59:15.292830 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:15.292551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:37547)
0620 14:59:15.292718 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:15.292774 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
I20260620 14:59:15.344368 28075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:15.344016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:57677)
0620 14:59:15.344231 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:15.344284 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":102,"threads_started":1}
I20260620 14:59:15.500497 28076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:15.500165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.131:38371)
0620 14:59:15.500395 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:15.500447 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":82,"threads_started":1}
I20260620 14:59:16.294157 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:16.293774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.129:40439)
0620 14:59:16.294008 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:16.294070 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":95,"threads_started":1}
I20260620 14:59:16.345342 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:16.345040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:39091 (local address 127.12.116.130:43463)
0620 14:59:16.345248 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:16.345294 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:39091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":102,"threads_started":1}
I20260620 14:59:16.487067 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27597
I20260620 14:59:16.493506 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27760
I20260620 14:59:16.499966 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 27894
2026-06-20T14:59:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18950 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 14:59:16 dist-test-slave-7v06 krb5kdc[28081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 14:59:16 dist-test-slave-7v06 krb5kdc[28081](info): set up 2 sockets
Jun 20 14:59:16 dist-test-slave-7v06 krb5kdc[28081](info): commencing operation
krb5kdc: starting...
W20260620 14:59:17.664656 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 14:59:17 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T14:59:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:59:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 14:59:17.816102 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43039
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:17.917346 28094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:17.917716 28094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:17.917752 28094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:17.919548 28094 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260620 14:59:17.919617 28094 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260620 14:59:17.919633 28094 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260620 14:59:17.919647 28094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:59:17.919664 28094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:17.919680 28094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:17.919701 28094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:59:17.919718 28094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:59:17.922068 28094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:17.922660 28094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:17.923064 28094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:17.930202 28099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:17.930202 28100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:17.930506 28094 server_base.cc:1034] running on GCE node
W20260620 14:59:17.930255 28102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:17.931635 28094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:17.932101 28094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:17.933509 28094 hybrid_clock.cc:648] HybridClock initialized: now 1781967557933488 us; error 60 us; skew 500 ppm
Jun 20 14:59:17 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967557, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:17.938236 28094 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:59:17.938872 28094 webserver.cc:460] Webserver started at http://127.12.116.190:38195/ using document root <none> and password file <none>
I20260620 14:59:17.939373 28094 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:17.939503 28094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:17.939684 28094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:59:17.941396 28094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "9ccb6d280e4243bebdb0229e454b8b95"
format_stamp: "Formatted at 2026-06-20 14:59:17 on dist-test-slave-7v06"
server_key: "1f6e61566eb79ec7a1e4573538096a40"
server_key_iv: "f41b141025a2527f0d2ed0fbbe0adee4"
server_key_version: "encryptionkey@0"
I20260620 14:59:17.941859 28094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "9ccb6d280e4243bebdb0229e454b8b95"
format_stamp: "Formatted at 2026-06-20 14:59:17 on dist-test-slave-7v06"
server_key: "1f6e61566eb79ec7a1e4573538096a40"
server_key_iv: "f41b141025a2527f0d2ed0fbbe0adee4"
server_key_version: "encryptionkey@0"
I20260620 14:59:17.943564 28094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:59:17.944765 28109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:17.945158 28094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:17.945322 28094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "9ccb6d280e4243bebdb0229e454b8b95"
format_stamp: "Formatted at 2026-06-20 14:59:17 on dist-test-slave-7v06"
server_key: "1f6e61566eb79ec7a1e4573538096a40"
server_key_iv: "f41b141025a2527f0d2ed0fbbe0adee4"
server_key_version: "encryptionkey@0"
I20260620 14:59:17.945427 28094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:17.970934 28094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:17.973631 28094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:17.973832 28094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:17.979046 28094 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43039
I20260620 14:59:17.979106 28161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43039 every 8 connection(s)
I20260620 14:59:17.979526 28094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:59:17.980620 28162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:17.983436 28162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap starting.
I20260620 14:59:17.984192 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28094
I20260620 14:59:17.984309 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 14:59:17.984370 28162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:17.984604 12754 external_mini_cluster.cc:1428] Setting key 35444b7c449db4ed8bce7d1f1223406a
I20260620 14:59:17.984769 28162 log.cc:824] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:17.985740 28162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: No bootstrap required, opened a new log
I20260620 14:59:17.989109 28162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:17.989349 28162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:17.989394 28162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ccb6d280e4243bebdb0229e454b8b95, State: Initialized, Role: FOLLOWER
I20260620 14:59:17.989583 28162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:17.990168 28162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:59:17.990267 28162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:59:17.990352 28162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:17.991199 28162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:17.991355 28162 leader_election.cc:302] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ccb6d280e4243bebdb0229e454b8b95; no voters:
I20260620 14:59:17.991609 28162 leader_election.cc:288] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 14:59:17.991667 28167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:59:17.991874 28167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 LEADER]: Becoming Leader. State: Replica: 9ccb6d280e4243bebdb0229e454b8b95, State: Running, Role: LEADER
I20260620 14:59:17.992018 28167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:17.992025 28162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:59:17.992566 28169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ccb6d280e4243bebdb0229e454b8b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } } }
I20260620 14:59:17.992648 28169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:17.992950 28168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ccb6d280e4243bebdb0229e454b8b95. Latest consensus state: current_term: 1 leader_uuid: "9ccb6d280e4243bebdb0229e454b8b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } } }
I20260620 14:59:17.993083 28168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:17.993849 28171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:59:17.994666 28171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 14:59:17 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:17.998732 28171 catalog_manager.cc:1347] Generated new cluster ID: 9e13348d3dff4a479390561c5d671bca
I20260620 14:59:17.998806 28171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:59:18.003716 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:17.985416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34526 (local address 127.12.116.190:43039)
0620 14:59:17.985660 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:17.985670 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:17.985708 (+ 38us) server_negotiation.cc:407] Connection header received
0620 14:59:17.986294 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:17.986302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:17.986360 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:17.986496 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:17.987637 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:17.989251 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:17.993009 (+ 3758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:17.994578 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:17.995500 (+ 922us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:17.999028 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:17.999052 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:17.999053 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:17.999077 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:18.001787 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.002305 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.002309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.002310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.002426 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.002676 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.002676 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.002677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.002987 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:18.003155 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.003299 (+ 144us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.003474 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":140,"threads_started":1}
I20260620 14:59:18.022112 28171 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:59:18.023027 28171 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:59:18.039973 28171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Generated new TSK 0
I20260620 14:59:18.040567 28171 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 14:59:18.080636 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43039
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:18.175990 28188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:18.176246 28188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:18.176296 28188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:18.177793 28188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:18.177858 28188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:18.177898 28188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:59:18.179672 28188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:18.180014 28188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:18.180344 28188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:18.186487 28193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:18.186487 28194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:18.186508 28196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:18.186733 28188 server_base.cc:1034] running on GCE node
I20260620 14:59:18.187086 28188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:18.187378 28188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:18.188561 28188 hybrid_clock.cc:648] HybridClock initialized: now 1781967558188477 us; error 99 us; skew 500 ppm
Jun 20 14:59:18 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:18.191526 28188 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:59:18.192133 28188 webserver.cc:460] Webserver started at http://127.12.116.129:43181/ using document root <none> and password file <none>
I20260620 14:59:18.192514 28188 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:18.192623 28188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:18.192816 28188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:59:18.194140 28188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "184ea7bfbf714a42a7d9bd1f68261a42"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "c2cd9b278d7e916122e9bd6ad70d2f40"
server_key_iv: "6cf411f53344edc5d41b26a81656d6a7"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.194543 28188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "184ea7bfbf714a42a7d9bd1f68261a42"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "c2cd9b278d7e916122e9bd6ad70d2f40"
server_key_iv: "6cf411f53344edc5d41b26a81656d6a7"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.196256 28188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:59:18.197666 28203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.198027 28188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:59:18.198171 28188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "184ea7bfbf714a42a7d9bd1f68261a42"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "c2cd9b278d7e916122e9bd6ad70d2f40"
server_key_iv: "6cf411f53344edc5d41b26a81656d6a7"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.198355 28188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:18.229745 28188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:18.232288 28188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:18.232535 28188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:18.232810 28188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:18.233160 28188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:18.233222 28188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.233258 28188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:18.233284 28188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.239394 28188 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:42537
I20260620 14:59:18.239441 28316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:42537 every 8 connection(s)
I20260620 14:59:18.239791 28188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
Jun 20 14:59:18 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:18.247062 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28188
I20260620 14:59:18.247257 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 14:59:18.247490 12754 external_mini_cluster.cc:1428] Setting key e8e7b10da754bb4b08c39740fd27056a
I20260620 14:59:18.252765 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.240918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:55233 (local address 127.12.116.190:43039)
0620 14:59:18.240978 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.240979 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.241343 (+ 364us) server_negotiation.cc:407] Connection header received
0620 14:59:18.241928 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.241930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.241943 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.242006 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:18.243079 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.243605 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.244728 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.244977 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.245070 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.247812 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:18.247814 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:18.247814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:18.247823 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:18.250237 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.250996 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.250998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.250999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.251119 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.251801 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.251802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.251803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.251953 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:18.252016 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.252477 (+ 461us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.252609 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 14:59:18.252977 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.240923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:55233)
0620 14:59:18.241158 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.241218 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.241797 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.242085 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.242089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.242718 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:18.242942 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.242947 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.243718 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.243719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.244616 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.244619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.245083 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.245084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.245231 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.245902 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:18.245913 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:18.247690 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:18.250379 (+ 2689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:18.250397 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:18.250401 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:18.250831 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:18.251524 (+ 693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:18.251525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:18.251526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:18.251715 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:18.252032 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:18.252039 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:18.252238 (+ 199us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.252401 (+ 163us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.252633 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":133,"threads_started":1}
I20260620 14:59:18.253571 28317 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43039
I20260620 14:59:18.253711 28317 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:18.253933 28317 heartbeater.cc:511] Master 127.12.116.190:43039 requested a full tablet report, sending...
I20260620 14:59:18.254685 28126 ts_manager.cc:194] Registered new tserver with Master: 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129:42537)
I20260620 14:59:18.255686 28126 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:55233
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 14:59:18.276538 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43039
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:18.368361 28322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:18.368618 28322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:18.368662 28322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:18.369953 28322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:18.370142 28322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:18.370187 28322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:59:18.372059 28322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:18.372406 28322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:18.372676 28322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:59:18.378559 28322 server_base.cc:1034] running on GCE node
W20260620 14:59:18.378533 28330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:18.378527 28328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:18.378533 28327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:18.379004 28322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:18.379243 28322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:18.380430 28322 hybrid_clock.cc:648] HybridClock initialized: now 1781967558380396 us; error 57 us; skew 500 ppm
Jun 20 14:59:18 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:18.383129 28322 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:59:18.383620 28322 webserver.cc:460] Webserver started at http://127.12.116.130:32815/ using document root <none> and password file <none>
I20260620 14:59:18.383832 28322 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:18.383885 28322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:18.383983 28322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:59:18.385191 28322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "fbd9111593f3cfd44d1e61c1e79848d3"
server_key_iv: "39b1006810b745c34fb2b6a1581fe6df"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.385526 28322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "fbd9111593f3cfd44d1e61c1e79848d3"
server_key_iv: "39b1006810b745c34fb2b6a1581fe6df"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.386940 28322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:59:18.387794 28337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.388046 28322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:18.388175 28322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "fbd9111593f3cfd44d1e61c1e79848d3"
server_key_iv: "39b1006810b745c34fb2b6a1581fe6df"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.388263 28322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:18.400540 28322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:18.403573 28322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:18.403769 28322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:18.404039 28322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:18.404469 28322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:18.404531 28322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.404577 28322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:18.404604 28322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.411512 28322 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:35721
I20260620 14:59:18.411559 28450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:35721 every 8 connection(s)
I20260620 14:59:18.411927 28322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:59:18.412433 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28322
I20260620 14:59:18.412559 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 14:59:18.412793 12754 external_mini_cluster.cc:1428] Setting key d1f33b3fb9d9e5fe67344bebcdb262f9
Jun 20 14:59:18 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
I20260620 14:59:18.423400 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.412810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:35321 (local address 127.12.116.190:43039)
0620 14:59:18.412874 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.412876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.413167 (+ 291us) server_negotiation.cc:407] Connection header received
0620 14:59:18.413786 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.413787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.413799 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.413864 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:18.414833 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.415494 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.416704 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.416956 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.417039 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.420065 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:18.420067 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:18.420067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:18.420078 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:18.421662 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.422305 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.422306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.422307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.422371 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.422669 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.422671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.422671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.422800 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:18.422882 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.423200 (+ 318us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.423295 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 14:59:18.423614 28453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.412807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:35321)
0620 14:59:18.413033 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.413080 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.413701 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.413919 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.413923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.414515 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:18.414725 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.414730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.415622 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.415623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.416596 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.416599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.417094 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.417095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.417300 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.417998 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:18.418011 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:18.419921 (+ 1910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:18.421812 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:18.421825 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:18.421828 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:18.422215 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:18.422445 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:18.422446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:18.422447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:18.422588 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:18.422871 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:18.422879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:18.423055 (+ 176us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.423179 (+ 124us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.423366 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":91,"threads_started":1}
I20260620 14:59:18.424438 28451 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43039
I20260620 14:59:18.424553 28451 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:18.424862 28451 heartbeater.cc:511] Master 127.12.116.190:43039 requested a full tablet report, sending...
I20260620 14:59:18.425505 28126 ts_manager.cc:194] Registered new tserver with Master: 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
I20260620 14:59:18.426007 28126 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:35321
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 14:59:18.444427 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43039
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:18.541554 28456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:18.541831 28456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:18.541875 28456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:18.543341 28456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:18.543463 28456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:18.543519 28456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:59:18.546006 28456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:18.546537 28456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:18.546883 28456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:18.553733 28464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:18.553743 28456 server_base.cc:1034] running on GCE node
W20260620 14:59:18.553735 28462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:18.553733 28461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:18.554435 28456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:18.554702 28456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:18.555887 28456 hybrid_clock.cc:648] HybridClock initialized: now 1781967558555873 us; error 32 us; skew 500 ppm
Jun 20 14:59:18 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:18.559032 28456 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:59:18.559612 28456 webserver.cc:460] Webserver started at http://127.12.116.131:46001/ using document root <none> and password file <none>
I20260620 14:59:18.559898 28456 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:18.559993 28456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:18.560164 28456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:59:18.561400 28456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "b0b248c7daf546108d259f591d250c5b"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "2ba0a98df6e0b9d5e89d308ddbe9aa20"
server_key_iv: "1179af7a680d906a64267afd99d46cbb"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.561803 28456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "b0b248c7daf546108d259f591d250c5b"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "2ba0a98df6e0b9d5e89d308ddbe9aa20"
server_key_iv: "1179af7a680d906a64267afd99d46cbb"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.563485 28456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 14:59:18.564772 28471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.565078 28456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:18.565199 28456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "b0b248c7daf546108d259f591d250c5b"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "2ba0a98df6e0b9d5e89d308ddbe9aa20"
server_key_iv: "1179af7a680d906a64267afd99d46cbb"
server_key_version: "encryptionkey@0"
I20260620 14:59:18.565302 28456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:18.587770 28456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:18.591060 28456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:18.591279 28456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:18.591619 28456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:18.592092 28456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:18.592163 28456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.592214 28456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:18.592244 28456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:18.602084 28456 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:46695
I20260620 14:59:18.602381 28584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:46695 every 8 connection(s)
I20260620 14:59:18.602664 28456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
Jun 20 14:59:18 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:18.611346 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28456
I20260620 14:59:18.611476 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 14:59:18.611681 12754 external_mini_cluster.cc:1428] Setting key 018a83a7dcca93ffc2b71aa7f1c3800a
I20260620 14:59:18.617815 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.603806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:50147 (local address 127.12.116.190:43039)
0620 14:59:18.603864 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.603867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.604102 (+ 235us) server_negotiation.cc:407] Connection header received
0620 14:59:18.605081 (+ 979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.605084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.605099 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.605135 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:18.606452 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.607051 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.608413 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.608670 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.608747 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.611826 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:18.611829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:18.611829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:18.611840 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:18.615817 (+ 3977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.616553 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.616555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.616556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.616638 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.616966 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.616967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.616968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.617131 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:18.617231 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.617584 (+ 353us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.617695 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 14:59:18.618065 28587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.603615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:50147)
0620 14:59:18.603947 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.604005 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.604917 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.605335 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.605339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.606055 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:18.606299 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.606305 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.607242 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.607244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.608217 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.608221 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.608808 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.608810 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.609003 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.609741 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:18.609752 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:18.611687 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:18.615994 (+ 4307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:18.616011 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:18.616015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:18.616431 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:18.616726 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:18.616727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:18.616728 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:18.616879 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:18.617219 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:18.617227 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:18.617416 (+ 189us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.617557 (+ 141us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.617780 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":107,"threads_started":1}
I20260620 14:59:18.619226 28585 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43039
I20260620 14:59:18.619354 28585 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:18.619599 28585 heartbeater.cc:511] Master 127.12.116.190:43039 requested a full tablet report, sending...
I20260620 14:59:18.620419 28126 ts_manager.cc:194] Registered new tserver with Master: b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
I20260620 14:59:18.620880 28126 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:50147
I20260620 14:59:18.624711 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:59:18.634272 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.626607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34534 (local address 127.12.116.190:43039)
0620 14:59:18.626698 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.626700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.626711 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:59:18.626743 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.626744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.626762 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.626821 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:18.627491 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.628068 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.629012 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.629210 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.629274 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.630681 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:18.630682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:18.630682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:18.630691 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:18.632672 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.633203 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.633205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.633205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.633283 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:18.633600 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:18.633601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:18.633601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:18.633795 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:18.634017 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.634108 (+ 91us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.634193 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260620 14:59:18.637578 28126 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:59:18.639493 28126 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:59:18.648939 28596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.644051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:46695 (local address 127.0.0.1:52166)
0620 14:59:18.644863 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.644872 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.644916 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.645105 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.645106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.645109 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:18.645157 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.645158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.646364 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.646366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.647572 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.647576 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.648552 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.648553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.648645 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.648664 (+ 19us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.648769 (+ 105us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.648834 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"mutex_wait_us":77,"thread_start_us":110,"threads_started":1}
I20260620 14:59:18.649351 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.644370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.12.116.131:46695)
0620 14:59:18.644729 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.644733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.644971 (+ 238us) server_negotiation.cc:407] Connection header received
0620 14:59:18.645015 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.645017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.645033 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.645107 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:18.645469 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.646225 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.647691 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.648451 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.648540 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.648605 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.649133 (+ 528us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.649195 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":100,"threads_started":1}
I20260620 14:59:18.649472 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.644043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:35721 (local address 127.0.0.1:40914)
0620 14:59:18.644269 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.644314 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.644535 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.644952 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.644955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.644959 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:18.645066 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.645069 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.646422 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.646423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.647958 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.647962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.648998 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.648999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.649073 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.649078 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.649318 (+ 240us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.649374 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":34,"thread_start_us":78,"threads_started":1}
I20260620 14:59:18.649742 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.644157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.12.116.130:35721)
0620 14:59:18.644617 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.644622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.644637 (+ 15us) server_negotiation.cc:407] Connection header received
0620 14:59:18.644693 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.644696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.644714 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.644803 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:18.645163 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.646297 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.648088 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.648860 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.648977 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.649035 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.649595 (+ 560us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.649655 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":103,"threads_started":1}
I20260620 14:59:18.650238 28598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.644048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:42537 (local address 127.0.0.1:33614)
0620 14:59:18.644725 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.644736 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.644796 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.645156 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.645157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.645160 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:18.645405 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.645411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.646944 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.646945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.648225 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.648227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.650040 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.650041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.650094 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.650098 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.650139 (+ 41us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.650173 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":124,"threads_started":1}
I20260620 14:59:18.650589 28601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.644373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33614 (local address 127.12.116.129:42537)
0620 14:59:18.644633 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.644638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.644900 (+ 262us) server_negotiation.cc:407] Connection header received
0620 14:59:18.644953 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.644956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.644973 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.645068 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:18.645531 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.646590 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.648353 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.649269 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.649351 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.650396 (+ 1045us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.650432 (+ 36us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.650496 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":126,"threads_started":1}
I20260620 14:59:18.650556 28519 tablet_service.cc:1467] Processing CreateTablet for tablet 34e262b84e73409f81e67493c65d30ea (DEFAULT_TABLE table=test-table [id=47ecbc265bac4827a25c9e5e4bfab8de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:18.651298 28519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e262b84e73409f81e67493c65d30ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:18.651404 28251 tablet_service.cc:1467] Processing CreateTablet for tablet 34e262b84e73409f81e67493c65d30ea (DEFAULT_TABLE table=test-table [id=47ecbc265bac4827a25c9e5e4bfab8de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:18.651405 28385 tablet_service.cc:1467] Processing CreateTablet for tablet 34e262b84e73409f81e67493c65d30ea (DEFAULT_TABLE table=test-table [id=47ecbc265bac4827a25c9e5e4bfab8de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:18.651777 28251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e262b84e73409f81e67493c65d30ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:18.651778 28385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e262b84e73409f81e67493c65d30ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:18.654451 28602 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Bootstrap starting.
I20260620 14:59:18.655215 28602 tablet_bootstrap.cc:654] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:18.655407 28604 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Bootstrap starting.
I20260620 14:59:18.655720 28603 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap starting.
I20260620 14:59:18.656015 28602 log.cc:824] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:18.656157 28604 tablet_bootstrap.cc:654] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:18.656457 28603 tablet_bootstrap.cc:654] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:18.656778 28604 log.cc:824] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:18.656944 28602 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: No bootstrap required, opened a new log
I20260620 14:59:18.657024 28602 ts_tablet_manager.cc:1397] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:59:18.657068 28603 log.cc:824] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:18.657778 28603 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: No bootstrap required, opened a new log
I20260620 14:59:18.657866 28603 ts_tablet_manager.cc:1397] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 14:59:18.658874 28602 raft_consensus.cc:348] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.659034 28602 raft_consensus.cc:374] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:18.659065 28602 raft_consensus.cc:729] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0b248c7daf546108d259f591d250c5b, State: Initialized, Role: FOLLOWER
I20260620 14:59:18.659224 28602 consensus_queue.cc:260] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.659544 28602 ts_tablet_manager.cc:1428] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:59:18.659595 28585 heartbeater.cc:503] Master 127.12.116.190:43039 was elected leader, sending a full tablet report...
I20260620 14:59:18.660513 28604 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: No bootstrap required, opened a new log
I20260620 14:59:18.660317 28603 raft_consensus.cc:348] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.660578 28603 raft_consensus.cc:374] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:18.660614 28604 ts_tablet_manager.cc:1397] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260620 14:59:18.660621 28603 raft_consensus.cc:729] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 184ea7bfbf714a42a7d9bd1f68261a42, State: Initialized, Role: FOLLOWER
I20260620 14:59:18.660750 28603 consensus_queue.cc:260] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.661087 28603 ts_tablet_manager.cc:1428] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260620 14:59:18.661123 28317 heartbeater.cc:503] Master 127.12.116.190:43039 was elected leader, sending a full tablet report...
I20260620 14:59:18.662809 28604 raft_consensus.cc:348] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.662999 28604 raft_consensus.cc:374] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:18.663048 28604 raft_consensus.cc:729] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bf130be33164fa7b4fd84939d4cd4c4, State: Initialized, Role: FOLLOWER
I20260620 14:59:18.663183 28604 consensus_queue.cc:260] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.663489 28604 ts_tablet_manager.cc:1428] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:59:18.663546 28451 heartbeater.cc:503] Master 127.12.116.190:43039 was elected leader, sending a full tablet report...
I20260620 14:59:18.667207 28609 raft_consensus.cc:482] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:18.667332 28609 raft_consensus.cc:504] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.667781 28609 leader_election.cc:288] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
I20260620 14:59:18.671098 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.668108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:38491 (local address 127.12.116.130:35721)
0620 14:59:18.668163 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.668166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.668351 (+ 185us) server_negotiation.cc:407] Connection header received
0620 14:59:18.668382 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.668383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.668393 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.668471 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:18.668636 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.669129 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.670286 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.670699 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.670799 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.670809 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.670969 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.671012 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 14:59:18.671139 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.668133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:58703 (local address 127.12.116.131:46695)
0620 14:59:18.668177 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.668179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.668187 (+ 8us) server_negotiation.cc:407] Connection header received
0620 14:59:18.668216 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.668217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.668245 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.668344 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:18.668552 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.669129 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.670314 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.670727 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.670833 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.670844 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.671016 (+ 172us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.671060 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:59:18.671149 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.668015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:46695 (local address 127.12.116.129:58703)
0620 14:59:18.668089 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.668101 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.668150 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.668390 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.668391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.668393 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:18.668468 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.668470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.669226 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.669227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.670215 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.670218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.670835 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.670836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.670921 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.670928 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.671007 (+ 79us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.671056 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":47}
I20260620 14:59:18.671149 28611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.668019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:35721 (local address 127.12.116.129:38491)
0620 14:59:18.668237 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.668245 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:18.668290 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:18.668476 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:18.668476 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:18.668478 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:18.668555 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.668557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.669227 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.669228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.670174 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:18.670177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.670798 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.670798 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:18.670880 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.670884 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 14:59:18.670963 (+ 79us) client_negotiation.cc:240] Negotiation successful
0620 14:59:18.671012 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":65,"thread_start_us":133,"threads_started":1}
I20260620 14:59:18.671510 28538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e262b84e73409f81e67493c65d30ea" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b248c7daf546108d259f591d250c5b" is_pre_election: true
I20260620 14:59:18.671509 28405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e262b84e73409f81e67493c65d30ea" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" is_pre_election: true
I20260620 14:59:18.671679 28405 raft_consensus.cc:2454] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 0.
I20260620 14:59:18.671679 28538 raft_consensus.cc:2454] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 0.
I20260620 14:59:18.671911 28206 leader_election.cc:302] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42, b0b248c7daf546108d259f591d250c5b; no voters:
I20260620 14:59:18.672262 28609 raft_consensus.cc:2781] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:59:18.672528 28609 raft_consensus.cc:482] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:59:18.672556 28609 raft_consensus.cc:3037] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:18.673539 28609 raft_consensus.cc:504] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.673732 28609 leader_election.cc:288] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 election: Requested vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
I20260620 14:59:18.674165 28538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e262b84e73409f81e67493c65d30ea" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b248c7daf546108d259f591d250c5b"
I20260620 14:59:18.674295 28538 raft_consensus.cc:3037] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:18.674332 28405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e262b84e73409f81e67493c65d30ea" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
I20260620 14:59:18.674481 28405 raft_consensus.cc:3037] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:18.675258 28538 raft_consensus.cc:2454] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 1.
I20260620 14:59:18.675413 28405 raft_consensus.cc:2454] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 1.
I20260620 14:59:18.675506 28206 leader_election.cc:302] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42, b0b248c7daf546108d259f591d250c5b; no voters:
I20260620 14:59:18.675619 28609 raft_consensus.cc:2781] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:59:18.675788 28609 raft_consensus.cc:686] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 LEADER]: Becoming Leader. State: Replica: 184ea7bfbf714a42a7d9bd1f68261a42, State: Running, Role: LEADER
I20260620 14:59:18.675887 28609 consensus_queue.cc:237] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:18.677003 28126 catalog_manager.cc:5495] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260620 14:59:18.683465 28601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.680937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33626 (local address 127.12.116.129:42537)
0620 14:59:18.681019 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:18.681022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:18.681033 (+ 11us) server_negotiation.cc:407] Connection header received
0620 14:59:18.681075 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:18.681080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:18.681098 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:18.681182 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:59:18.681331 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.681836 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.682644 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:18.682850 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:18.682935 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:18.683098 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:59:18.683208 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:59:18.683304 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:18.683328 (+ 24us) server_negotiation.cc:299] Negotiation successful
0620 14:59:18.683351 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260620 14:59:18.685477 28405 raft_consensus.cc:1261] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Refusing update from remote peer 184ea7bfbf714a42a7d9bd1f68261a42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:59:18.685479 28538 raft_consensus.cc:1261] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Refusing update from remote peer 184ea7bfbf714a42a7d9bd1f68261a42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:59:18.685883 28609 consensus_queue.cc:1035] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:59:18.686048 28612 consensus_queue.cc:1035] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:59:18.690011 28618 mvcc.cc:205] Tried to move back new op lower bound from 7298939120372088832 to 7298939120337227776. Current Snapshot: MvccSnapshot[applied={T|T < 7298939120372088832}]
I20260620 14:59:18.692016 28125 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:59:18.692165 28125 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:59:18.693022 28125 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Sending DeleteTablet for 3 replicas of tablet 34e262b84e73409f81e67493c65d30ea
I20260620 14:59:18.693369 28251 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e262b84e73409f81e67493c65d30ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:18 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:33614
I20260620 14:59:18.693414 28385 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e262b84e73409f81e67493c65d30ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:18 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:40914
I20260620 14:59:18.693526 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28188
I20260620 14:59:18.694856 28519 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e262b84e73409f81e67493c65d30ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:18 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:52166
I20260620 14:59:18.695271 28625 tablet_replica.cc:330] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: stopping tablet replica
I20260620 14:59:18.695402 28625 raft_consensus.cc:2229] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:18.695521 28625 raft_consensus.cc:2258] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:18.695952 28625 ts_tablet_manager.cc:1905] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:18.698836 28625 ts_tablet_manager.cc:1918] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:18.699113 28625 log.cc:1196] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/34e262b84e73409f81e67493c65d30ea
I20260620 14:59:18.699467 28625 ts_tablet_manager.cc:1939] T 34e262b84e73409f81e67493c65d30ea P 6bf130be33164fa7b4fd84939d4cd4c4: Deleting consensus metadata
W20260620 14:59:18.699505 28111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:42537 (error 108)
I20260620 14:59:18.699753 28626 tablet_replica.cc:330] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: stopping tablet replica
I20260620 14:59:18.699898 28626 raft_consensus.cc:2229] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:18.700011 28113 catalog_manager.cc:4841] TS 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): tablet 34e262b84e73409f81e67493c65d30ea (table test-table [id=47ecbc265bac4827a25c9e5e4bfab8de]) successfully deleted
I20260620 14:59:18.700076 28626 raft_consensus.cc:2258] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:18.700287 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28322
I20260620 14:59:18.701009 28598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.700387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:42537 (local address 127.0.0.1:33628)
0620 14:59:18.700903 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.700963 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:42537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492}
W20260620 14:59:18.701215 28111 catalog_manager.cc:4584] TS 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129:42537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 34e262b84e73409f81e67493c65d30ea: Network error: Client connection negotiation failed: client connection to 127.12.116.129:42537: connect: Connection refused (error 111)
I20260620 14:59:18.704869 28626 ts_tablet_manager.cc:1905] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:18.705952 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28456
I20260620 14:59:18.711689 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28094
I20260620 14:59:18.711731 28598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:18.711585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:46695 (local address 127.0.0.1:52170)
0620 14:59:18.711654 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:18.711694 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.131:46695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260620 14:59:38.717603 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43039
--webserver_interface=127.12.116.190
--webserver_port=38195
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:38.812467 28628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:38.812728 28628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:38.812755 28628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:38.814432 28628 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260620 14:59:38.814508 28628 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260620 14:59:38.814523 28628 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260620 14:59:38.814535 28628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:59:38.814550 28628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:38.814564 28628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:38.814628 28628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:59:38.814651 28628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:59:38.816851 28628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=38195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:38.817266 28628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:38.817584 28628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:59:38.829816 28628 server_base.cc:1034] running on GCE node
W20260620 14:59:38.829799 28635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:38.829795 28634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:38.830026 28637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:38.830406 28628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:38.830797 28628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:38.832024 28628 hybrid_clock.cc:648] HybridClock initialized: now 1781967578831964 us; error 71 us; skew 500 ppm
Jun 20 14:59:38 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967578, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:38.835086 28628 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:59:38.835687 28628 webserver.cc:460] Webserver started at http://127.12.116.190:38195/ using document root <none> and password file <none>
I20260620 14:59:38.835978 28628 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:38.836077 28628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:38.837988 28628 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:38.839208 28644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:38.839537 28628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:38.839684 28628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "9ccb6d280e4243bebdb0229e454b8b95"
format_stamp: "Formatted at 2026-06-20 14:59:17 on dist-test-slave-7v06"
server_key: "1f6e61566eb79ec7a1e4573538096a40"
server_key_iv: "f41b141025a2527f0d2ed0fbbe0adee4"
server_key_version: "encryptionkey@0"
I20260620 14:59:38.840238 28628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:38.859440 28628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:38.862119 28628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:38.862320 28628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:38.866916 28628 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43039
I20260620 14:59:38.867110 28696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43039 every 8 connection(s)
I20260620 14:59:38.867430 28628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:59:38.869065 28697 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:59:38.869827 28697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap starting.
I20260620 14:59:38.874115 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28628
I20260620 14:59:38.874455 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:42537
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:43039
--webserver_port=43181
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:38.880645 28697 log.cc:824] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:38.883436 28697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:38.883838 28697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap complete.
I20260620 14:59:38.886407 28697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:38.886686 28697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ccb6d280e4243bebdb0229e454b8b95, State: Initialized, Role: FOLLOWER
I20260620 14:59:38.886863 28697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:38.886934 28697 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:59:38.886994 28697 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:59:38.887080 28697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:59:38.888460 28697 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:38.888630 28697 leader_election.cc:302] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ccb6d280e4243bebdb0229e454b8b95; no voters:
I20260620 14:59:38.888850 28697 leader_election.cc:288] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 14:59:38.888896 28701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 14:59:38.889021 28701 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 LEADER]: Becoming Leader. State: Replica: 9ccb6d280e4243bebdb0229e454b8b95, State: Running, Role: LEADER
I20260620 14:59:38.889120 28701 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:38.889147 28697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:59:38.889958 28703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ccb6d280e4243bebdb0229e454b8b95. Latest consensus state: current_term: 2 leader_uuid: "9ccb6d280e4243bebdb0229e454b8b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } } }
I20260620 14:59:38.890064 28703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:38.890177 28702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ccb6d280e4243bebdb0229e454b8b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } } }
I20260620 14:59:38.890257 28702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:38.890288 28711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:59:38.891494 28711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:59:38.891623 28711 catalog_manager.cc:1259] Loaded cluster ID: 9e13348d3dff4a479390561c5d671bca
I20260620 14:59:38.891764 28711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:59:38.893280 28711 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:59:38.893620 28711 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Loaded TSK: 0
I20260620 14:59:38.902536 28711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Generated new TSK 1
I20260620 14:59:38.902683 28711 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 14:59:38.991616 28699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:38.991918 28699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:38.991976 28699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:38.993510 28699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:38.993603 28699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:38.993654 28699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:59:38.995464 28699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:42537
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=43181
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:38.995793 28699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:38.996243 28699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:39.003436 28727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:39.003559 28724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:39.003436 28725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:39.004106 28699 server_base.cc:1034] running on GCE node
I20260620 14:59:39.004390 28699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:39.005076 28699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:39.006320 28699 hybrid_clock.cc:648] HybridClock initialized: now 1781967579006301 us; error 42 us; skew 500 ppm
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967579, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:39.009322 28699 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:59:39.009964 28699 webserver.cc:460] Webserver started at http://127.12.116.129:43181/ using document root <none> and password file <none>
I20260620 14:59:39.010227 28699 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:39.010293 28699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:39.013274 28699 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 14:59:39.014760 28734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:39.015036 28699 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:39.015188 28699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "184ea7bfbf714a42a7d9bd1f68261a42"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "c2cd9b278d7e916122e9bd6ad70d2f40"
server_key_iv: "6cf411f53344edc5d41b26a81656d6a7"
server_key_version: "encryptionkey@0"
I20260620 14:59:39.015811 28699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:39.028993 28699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:39.031956 28699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:39.032227 28699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:39.032647 28699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:39.033336 28741 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 14:59:39.035212 28699 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 14:59:39.035290 28699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260620 14:59:39.035326 28699 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 14:59:39.036778 28699 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 14:59:39.036871 28699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260620 14:59:39.036938 28741 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap starting.
I20260620 14:59:39.046365 28699 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:42537
I20260620 14:59:39.047015 28699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:59:39.047024 28848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:42537 every 8 connection(s)
I20260620 14:59:39.050988 28741 log.cc:824] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:39.054311 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28699
I20260620 14:59:39.054661 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:35721
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:43039
--webserver_port=32815
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:39.054593 28741 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:39.055135 28741 tablet_bootstrap.cc:492] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap complete.
I20260620 14:59:39.056411 28741 ts_tablet_manager.cc:1397] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.017s
I20260620 14:59:39.058101 28741 raft_consensus.cc:348] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:39.058465 28741 raft_consensus.cc:729] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 184ea7bfbf714a42a7d9bd1f68261a42, State: Initialized, Role: FOLLOWER
I20260620 14:59:39.058645 28741 consensus_queue.cc:260] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } } peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } }
I20260620 14:59:39.058949 28741 ts_tablet_manager.cc:1428] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967579, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:39.067132 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.049145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:45793)
0620 14:59:39.051463 (+ 2318us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.051504 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.055892 (+ 4388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.056676 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.056680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.057077 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:39.057381 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.057389 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.059102 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.059103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.059971 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.059975 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.060722 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.060722 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.060855 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.061451 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:39.061460 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:39.062909 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:39.065238 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.065250 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.065253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.065537 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.065856 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.065856 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.065857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.065978 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.066410 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:39.066417 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:39.066563 (+ 146us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.066675 (+ 112us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.066890 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2274,"thread_start_us":139,"threads_started":1}
I20260620 14:59:39.067166 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.049206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:45793 (local address 127.12.116.190:43039)
0620 14:59:39.051373 (+ 2167us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.051383 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.051648 (+ 265us) server_negotiation.cc:407] Connection header received
0620 14:59:39.056206 (+ 4558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.056215 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.056284 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.056458 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:39.057561 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.058956 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.060090 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.060600 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.060743 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.063080 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:39.063085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:39.063086 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:39.063103 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:39.065095 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.065661 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.065665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.065665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.065773 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.066058 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.066059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.066059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.066326 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:39.066419 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.066744 (+ 325us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.066890 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2103,"thread_start_us":83,"threads_started":1}
I20260620 14:59:39.068315 28849 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43039
I20260620 14:59:39.068470 28849 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:39.068689 28849 heartbeater.cc:511] Master 127.12.116.190:43039 requested a full tablet report, sending...
I20260620 14:59:39.069752 28661 ts_manager.cc:194] Registered new tserver with Master: 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129:42537)
I20260620 14:59:39.077337 28661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:45793
I20260620 14:59:39.079113 28849 heartbeater.cc:503] Master 127.12.116.190:43039 was elected leader, sending a full tablet report...
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967578, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.129@KRBTEST.COM
I20260620 14:59:39.088845 28857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.070723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.12.116.129:42537)
0620 14:59:39.077488 (+ 6765us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.077496 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.077673 (+ 177us) server_negotiation.cc:407] Connection header received
0620 14:59:39.078371 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.078375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.078400 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.078468 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:39.080278 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.081272 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.082381 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.082756 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.082889 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.085414 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:39.085438 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:39.085438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:39.085447 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:39.087249 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.087792 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.087795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.087796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.087863 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.088092 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.088093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.088094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.088270 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:39.088420 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.088619 (+ 199us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.088731 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6689,"thread_start_us":89,"threads_started":1}
I20260620 14:59:39.089180 28856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.070426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:42537 (local address 127.0.0.1:58014)
0620 14:59:39.070904 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.070941 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.077735 (+ 6794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.079502 (+ 1767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.079506 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.080043 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:39.080116 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.080120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.081386 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.081388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.082262 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.082267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.082892 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.082893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.083003 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.083645 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:39.083650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:39.085286 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:39.087386 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.087398 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.087400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.087689 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.087944 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.087945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.087945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.088022 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.088381 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:39.088389 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:39.088454 (+ 65us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.088566 (+ 112us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.089055 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":113,"threads_started":1}
I20260620 14:59:39.090081 28783 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e262b84e73409f81e67493c65d30ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:18 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:58014
I20260620 14:59:39.093624 28858 tablet_replica.cc:330] stopping tablet replica
I20260620 14:59:39.093801 28858 raft_consensus.cc:2229] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:39.093911 28858 raft_consensus.cc:2258] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:39.094281 28858 ts_tablet_manager.cc:1905] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:39.097368 28858 ts_tablet_manager.cc:1918] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:39.097507 28858 log.cc:1196] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal/wals/34e262b84e73409f81e67493c65d30ea
I20260620 14:59:39.097797 28858 ts_tablet_manager.cc:1939] T 34e262b84e73409f81e67493c65d30ea P 184ea7bfbf714a42a7d9bd1f68261a42: Deleting consensus metadata
I20260620 14:59:39.098991 28646 catalog_manager.cc:4841] TS 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129:42537): tablet 34e262b84e73409f81e67493c65d30ea (table test-table [id=47ecbc265bac4827a25c9e5e4bfab8de]) successfully deleted
W20260620 14:59:39.182915 28854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:39.183176 28854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:39.183205 28854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:39.184860 28854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:39.184938 28854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:39.184973 28854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 14:59:39.186764 28854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:35721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=32815
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:39.187064 28854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:39.187368 28854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:39.193895 28866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:39.194000 28864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:39.194631 28863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:39.194741 28854 server_base.cc:1034] running on GCE node
I20260620 14:59:39.194977 28854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:39.195304 28854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:39.196542 28854 hybrid_clock.cc:648] HybridClock initialized: now 1781967579196520 us; error 41 us; skew 500 ppm
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967579, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:39.201058 28854 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 14:59:39.201635 28854 webserver.cc:460] Webserver started at http://127.12.116.130:32815/ using document root <none> and password file <none>
I20260620 14:59:39.201913 28854 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:39.202028 28854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:39.203784 28854 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:39.204926 28873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:39.205305 28854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:39.205425 28854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "fbd9111593f3cfd44d1e61c1e79848d3"
server_key_iv: "39b1006810b745c34fb2b6a1581fe6df"
server_key_version: "encryptionkey@0"
I20260620 14:59:39.205896 28854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:39.217855 28854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:39.220126 28854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:39.220307 28854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:39.220679 28854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:39.221042 28854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:59:39.221131 28854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:39.221171 28854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:39.221199 28854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:39.228070 28854 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:35721
I20260620 14:59:39.228111 28986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:35721 every 8 connection(s)
I20260620 14:59:39.228587 28854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 14:59:39.236460 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28854
I20260620 14:59:39.236862 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:46695
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:43039
--webserver_port=46001
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967579, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:39.245445 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.229438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:45491 (local address 127.12.116.190:43039)
0620 14:59:39.229514 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.229516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.229682 (+ 166us) server_negotiation.cc:407] Connection header received
0620 14:59:39.230178 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.230179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.230192 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.230267 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:39.232150 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.232990 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.234959 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.235222 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.235328 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.240759 (+ 5431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:39.240764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:39.240764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:39.240785 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:39.243178 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.243954 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.243957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.243957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.244049 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.244396 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.244397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.244398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.244633 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:39.244738 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.245134 (+ 396us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.245279 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 14:59:39.245504 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.229358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:45491)
0620 14:59:39.229531 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.229575 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.230079 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.230345 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.230349 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.231491 (+ 1142us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:39.231803 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.231815 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.233203 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.233205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.234744 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.234756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.235411 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.235412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.235618 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.236763 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:39.236779 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:39.240461 (+ 3682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:39.243319 (+ 2858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.243336 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.243339 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.243844 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.244147 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.244148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.244148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.244279 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.244753 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:39.244761 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:39.244928 (+ 167us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.245076 (+ 148us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.245259 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260620 14:59:39.246546 28987 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43039
I20260620 14:59:39.246693 28987 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:39.247007 28987 heartbeater.cc:511] Master 127.12.116.190:43039 requested a full tablet report, sending...
I20260620 14:59:39.248013 28661 ts_manager.cc:194] Registered new tserver with Master: 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721)
I20260620 14:59:39.248835 28661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:45491
W20260620 14:59:39.333384 28990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:39.333671 28990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:39.333714 28990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:39.335016 28990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:39.335095 28990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:39.335145 28990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 14:59:39.336830 28990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:46695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=46001
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:39.337162 28990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:39.337414 28990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:39.343276 28996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:39.343250 28998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:39.343281 28995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:39.343444 28990 server_base.cc:1034] running on GCE node
I20260620 14:59:39.343778 28990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:39.344110 28990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:39.345243 28990 hybrid_clock.cc:648] HybridClock initialized: now 1781967579345225 us; error 42 us; skew 500 ppm
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967579, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:39.348027 28990 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 14:59:39.348590 28990 webserver.cc:460] Webserver started at http://127.12.116.131:46001/ using document root <none> and password file <none>
I20260620 14:59:39.348843 28990 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:39.348938 28990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:39.350449 28990 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:59:39.351291 29005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:39.351552 28990 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:39.351692 28990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "b0b248c7daf546108d259f591d250c5b"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "2ba0a98df6e0b9d5e89d308ddbe9aa20"
server_key_iv: "1179af7a680d906a64267afd99d46cbb"
server_key_version: "encryptionkey@0"
I20260620 14:59:39.352121 28990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:39.364533 28990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:39.368053 28990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:39.368197 28990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:39.368597 28990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:39.369097 29012 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260620 14:59:39.370719 29012 ts_tablet_manager.cc:1852] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260620 14:59:39.371014 29012 ts_tablet_manager.cc:1905] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:39.373678 29012 ts_tablet_manager.cc:1918] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:39.373849 29012 log.cc:1196] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/34e262b84e73409f81e67493c65d30ea
I20260620 14:59:39.374140 29012 ts_tablet_manager.cc:1939] T 34e262b84e73409f81e67493c65d30ea P b0b248c7daf546108d259f591d250c5b: Deleting consensus metadata
I20260620 14:59:39.374512 28990 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260620 14:59:39.374603 28990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260620 14:59:39.374645 28990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:59:39.374681 28990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:39.381453 28990 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:46695
I20260620 14:59:39.381729 29119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:46695 every 8 connection(s)
I20260620 14:59:39.381950 28990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 14:59:39.386260 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 28990
Jun 20 14:59:39 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967579, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 14:59:39.395638 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.382943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:44997 (local address 127.12.116.190:43039)
0620 14:59:39.382997 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.382999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.383726 (+ 727us) server_negotiation.cc:407] Connection header received
0620 14:59:39.384800 (+ 1074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.384803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.384824 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.384899 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:39.385788 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.386703 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.388041 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.388290 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.388437 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.390994 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:39.390996 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:39.390997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:39.391005 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:39.392774 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.393453 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.393454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.393455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.393520 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.393912 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.393914 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.393915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.394183 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:39.394467 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.395058 (+ 591us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.395491 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 14:59:39.396461 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.383151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:44997)
0620 14:59:39.383478 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.383523 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.384600 (+ 1077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.385015 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.385020 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.385389 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0620 14:59:39.385657 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.385662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.386872 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.386873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.387912 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.387916 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.388437 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.388438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.388604 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.389211 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 14:59:39.389220 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 14:59:39.390841 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 14:59:39.392879 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.392907 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.392911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.393355 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.393601 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 14:59:39.393602 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 14:59:39.393602 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 14:59:39.393786 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 14:59:39.394516 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 14:59:39.394535 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 14:59:39.394839 (+ 304us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.395011 (+ 172us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.395356 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":163,"threads_started":1}
I20260620 14:59:39.396517 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.386935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54270 (local address 127.12.116.190:43039)
0620 14:59:39.387096 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.387098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.387162 (+ 64us) server_negotiation.cc:407] Connection header received
0620 14:59:39.387251 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.387252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.387266 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.387370 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:39.388045 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.388671 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.389704 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.390035 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.390120 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.391737 (+ 1617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:39.391738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:39.391739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:39.391747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:39.393623 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.394539 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.394540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.394541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.394630 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.394937 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.394938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.394938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.395112 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:39.395433 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.395641 (+ 208us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.396374 (+ 733us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260620 14:59:39.397754 29120 heartbeater.cc:347] Connected to a master server at 127.12.116.190:43039
I20260620 14:59:39.397949 29120 heartbeater.cc:464] Registering TS with master...
I20260620 14:59:39.398468 29120 heartbeater.cc:511] Master 127.12.116.190:43039 requested a full tablet report, sending...
I20260620 14:59:39.399189 28660 ts_manager.cc:194] Registered new tserver with Master: b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
I20260620 14:59:39.399637 28660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:44997
I20260620 14:59:39.410137 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:59:39.414628 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.410635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54278 (local address 127.12.116.190:43039)
0620 14:59:39.410701 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.410703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.410813 (+ 110us) server_negotiation.cc:407] Connection header received
0620 14:59:39.410879 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.410880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.410926 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.410995 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:59:39.411166 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.411675 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.413356 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.413805 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.413900 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.414111 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:59:39.414182 (+ 71us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0620 14:59:39.414516 (+ 334us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54278: token expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260620 14:59:39.414716 29124 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54278: token expired
W20260620 14:59:39.414888 28590 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.116.190:43039)
I20260620 14:59:39.424202 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.415229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.12.116.190:43039)
0620 14:59:39.415288 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.415291 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.415366 (+ 75us) server_negotiation.cc:407] Connection header received
0620 14:59:39.415398 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.415399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.415414 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.415502 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0620 14:59:39.416085 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.417012 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.418294 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.418699 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.418802 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.420661 (+ 1859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 14:59:39.420664 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 14:59:39.420664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 14:59:39.420671 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 14:59:39.422424 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.423012 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.423013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.423013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.423079 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 14:59:39.423369 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 14:59:39.423370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 14:59:39.423370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 14:59:39.423514 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 14:59:39.423610 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.423919 (+ 309us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.424129 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:59:39.425736 28660 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:59:39.427672 28660 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:59:39.431457 28783 tablet_service.cc:1467] Processing CreateTablet for tablet 956fdf81344b4013bccb342a1de7d736 (DEFAULT_TABLE table=test-table [id=0e0d382cdd514c229b50e675bf151a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:39.431727 28783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956fdf81344b4013bccb342a1de7d736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:39.433481 28741 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap starting.
I20260620 14:59:39.433845 28741 tablet_bootstrap.cc:654] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:39.434388 28741 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: No bootstrap required, opened a new log
I20260620 14:59:39.434456 28741 ts_tablet_manager.cc:1397] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260620 14:59:39.434798 28741 raft_consensus.cc:348] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.434880 28741 raft_consensus.cc:374] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:39.434931 28741 raft_consensus.cc:729] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 184ea7bfbf714a42a7d9bd1f68261a42, State: Initialized, Role: FOLLOWER
I20260620 14:59:39.434978 28741 consensus_queue.cc:260] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.435065 28741 ts_tablet_manager.cc:1428] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260620 14:59:39.435425 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.431053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:35721 (local address 127.0.0.1:48400)
0620 14:59:39.431406 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.431416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.431477 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.431847 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.431849 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.431851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:39.431910 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.431913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.433104 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.433105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.434185 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.434188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.435103 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.435104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.435177 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.435199 (+ 22us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.435254 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.435303 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":26,"thread_start_us":78,"threads_started":1}
I20260620 14:59:39.435732 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.431210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48400 (local address 127.12.116.130:35721)
0620 14:59:39.431379 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.431384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.431479 (+ 95us) server_negotiation.cc:407] Connection header received
0620 14:59:39.431565 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.431567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.431602 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.431700 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:39.432084 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.433012 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.434300 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.434920 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.434993 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.435067 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.435589 (+ 522us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.435645 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260620 14:59:39.436358 28856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.431051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:46695 (local address 127.0.0.1:60956)
0620 14:59:39.431146 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.431159 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.431206 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.432636 (+ 1430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.432637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.432639 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:39.432682 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.432684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.433916 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.433917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.435029 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.435032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.436096 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.436096 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.436170 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.436176 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.436234 (+ 58us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.436277 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260620 14:59:39.436384 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.431234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60956 (local address 127.12.116.131:46695)
0620 14:59:39.432457 (+ 1223us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.432462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.432475 (+ 13us) server_negotiation.cc:407] Connection header received
0620 14:59:39.432515 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.432517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.432533 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.432625 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:39.432751 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.433741 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.435211 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.436019 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.436076 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.436111 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.436244 (+ 133us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.436275 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1182,"thread_start_us":96,"threads_started":1}
I20260620 14:59:39.436524 28921 tablet_service.cc:1467] Processing CreateTablet for tablet 956fdf81344b4013bccb342a1de7d736 (DEFAULT_TABLE table=test-table [id=0e0d382cdd514c229b50e675bf151a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:39.436928 28921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956fdf81344b4013bccb342a1de7d736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:39.436878 29054 tablet_service.cc:1467] Processing CreateTablet for tablet 956fdf81344b4013bccb342a1de7d736 (DEFAULT_TABLE table=test-table [id=0e0d382cdd514c229b50e675bf151a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:59:39.437142 29054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956fdf81344b4013bccb342a1de7d736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:59:39.439586 29012 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Bootstrap starting.
I20260620 14:59:39.440825 29012 tablet_bootstrap.cc:654] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:39.440869 29133 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Bootstrap starting.
I20260620 14:59:39.441272 29012 log.cc:824] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:39.441469 29133 tablet_bootstrap.cc:654] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Neither blocks nor log segments found. Creating new log.
I20260620 14:59:39.441989 29133 log.cc:824] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:39.442130 29012 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: No bootstrap required, opened a new log
I20260620 14:59:39.442215 29012 ts_tablet_manager.cc:1397] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:59:39.442683 29133 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: No bootstrap required, opened a new log
I20260620 14:59:39.442837 29133 ts_tablet_manager.cc:1397] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:59:39.443842 29012 raft_consensus.cc:348] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.444106 29012 raft_consensus.cc:374] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:39.444151 29012 raft_consensus.cc:729] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0b248c7daf546108d259f591d250c5b, State: Initialized, Role: FOLLOWER
I20260620 14:59:39.444288 29012 consensus_queue.cc:260] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.444693 29120 heartbeater.cc:503] Master 127.12.116.190:43039 was elected leader, sending a full tablet report...
I20260620 14:59:39.444702 29012 ts_tablet_manager.cc:1428] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:59:39.444895 29133 raft_consensus.cc:348] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.445142 29133 raft_consensus.cc:374] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:59:39.445196 29133 raft_consensus.cc:729] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bf130be33164fa7b4fd84939d4cd4c4, State: Initialized, Role: FOLLOWER
I20260620 14:59:39.445318 29133 consensus_queue.cc:260] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.445636 29133 ts_tablet_manager.cc:1428] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:59:39.445652 28987 heartbeater.cc:503] Master 127.12.116.190:43039 was elected leader, sending a full tablet report...
W20260620 14:59:39.479332 28988 tablet.cc:2369] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:59:39.528450 28855 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:59:39.528640 28855 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.529048 28855 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
I20260620 14:59:39.533942 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.529414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:57759 (local address 127.12.116.131:46695)
0620 14:59:39.529461 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.529463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.529483 (+ 20us) server_negotiation.cc:407] Connection header received
0620 14:59:39.529536 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.529537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.529548 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.529627 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:39.529924 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.530694 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.532637 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.533229 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.533326 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.533338 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.533809 (+ 471us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.533865 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 14:59:39.533998 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.529393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:46649 (local address 127.12.116.130:35721)
0620 14:59:39.529444 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.529447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.529549 (+ 102us) server_negotiation.cc:407] Connection header received
0620 14:59:39.529580 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.529582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.529591 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.529648 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:59:39.529924 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.530689 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.532621 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.533265 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.533343 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.533352 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.533809 (+ 457us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.533862 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 14:59:39.534014 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.529285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:46695 (local address 127.12.116.129:57759)
0620 14:59:39.529355 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.529368 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.529436 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.529668 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.529669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.529671 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:39.529794 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.529796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.530812 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.530814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.532464 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.532469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.533432 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.533433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.533612 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.533659 (+ 47us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.533746 (+ 87us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.533805 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":104}
I20260620 14:59:39.534017 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.529285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:35721 (local address 127.12.116.129:46649)
0620 14:59:39.529472 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.529482 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:39.529542 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:59:39.529668 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 14:59:39.529669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 14:59:39.529671 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 14:59:39.529802 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.529804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.530813 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.530814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.532464 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 14:59:39.532469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.533516 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.533520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 14:59:39.533611 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.533659 (+ 48us) client_negotiation.cc:769] Sending connection context
0620 14:59:39.533746 (+ 87us) client_negotiation.cc:240] Negotiation successful
0620 14:59:39.533805 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":143,"thread_start_us":85,"threads_started":1}
I20260620 14:59:39.534443 29074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956fdf81344b4013bccb342a1de7d736" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b248c7daf546108d259f591d250c5b" is_pre_election: true
I20260620 14:59:39.534618 28941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956fdf81344b4013bccb342a1de7d736" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" is_pre_election: true
I20260620 14:59:39.534659 29074 raft_consensus.cc:2454] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 0.
I20260620 14:59:39.534750 28941 raft_consensus.cc:2454] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 0.
I20260620 14:59:39.534952 28737 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42, b0b248c7daf546108d259f591d250c5b; no voters:
I20260620 14:59:39.535135 28855 raft_consensus.cc:2781] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:59:39.535203 28855 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:59:39.535228 28855 raft_consensus.cc:3037] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:39.536144 28855 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.536316 28855 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 election: Requested vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
I20260620 14:59:39.536612 29074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956fdf81344b4013bccb342a1de7d736" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b248c7daf546108d259f591d250c5b"
I20260620 14:59:39.536778 28941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956fdf81344b4013bccb342a1de7d736" candidate_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
I20260620 14:59:39.536805 29074 raft_consensus.cc:3037] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:39.536909 28941 raft_consensus.cc:3037] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:59:39.538100 29074 raft_consensus.cc:2454] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 1.
I20260620 14:59:39.538100 28941 raft_consensus.cc:2454] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 184ea7bfbf714a42a7d9bd1f68261a42 in term 1.
I20260620 14:59:39.538348 28737 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42, b0b248c7daf546108d259f591d250c5b; no voters:
I20260620 14:59:39.538470 28855 raft_consensus.cc:2781] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:59:39.538662 28855 raft_consensus.cc:686] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 LEADER]: Becoming Leader. State: Replica: 184ea7bfbf714a42a7d9bd1f68261a42, State: Running, Role: LEADER
I20260620 14:59:39.538733 28855 consensus_queue.cc:237] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:39.539836 28660 catalog_manager.cc:5495] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } health_report { overall_health: HEALTHY } } }
W20260620 14:59:39.549305 28850 tablet.cc:2369] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:59:39.556430 28857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.553164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58024 (local address 127.12.116.129:42537)
0620 14:59:39.553230 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 14:59:39.553232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 14:59:39.553242 (+ 10us) server_negotiation.cc:407] Connection header received
0620 14:59:39.553295 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:59:39.553296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:59:39.553314 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:59:39.553397 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 14:59:39.553555 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.554089 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.554851 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:59:39.555192 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:59:39.555331 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:59:39.555679 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 14:59:39.555802 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 14:59:39.555873 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 14:59:39.556031 (+ 158us) server_negotiation.cc:299] Negotiation successful
0620 14:59:39.556101 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 14:59:39.558842 29074 raft_consensus.cc:1261] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Refusing update from remote peer 184ea7bfbf714a42a7d9bd1f68261a42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:59:39.559502 28941 raft_consensus.cc:1261] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Refusing update from remote peer 184ea7bfbf714a42a7d9bd1f68261a42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:59:39.559676 28855 consensus_queue.cc:1035] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:59:39.560238 29139 consensus_queue.cc:1035] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:59:39.563525 29142 mvcc.cc:205] Tried to move back new op lower bound from 7298939205868318720 to 7298939205791567872. Current Snapshot: MvccSnapshot[applied={T|T < 7298939205868318720}]
I20260620 14:59:39.563941 29143 mvcc.cc:205] Tried to move back new op lower bound from 7298939205868318720 to 7298939205791567872. Current Snapshot: MvccSnapshot[applied={T|T < 7298939205868318720}]
I20260620 14:59:39.565943 28660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:59:39.566052 28660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 14:59:39.567095 28660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Sending DeleteTablet for 3 replicas of tablet 956fdf81344b4013bccb342a1de7d736
I20260620 14:59:39.567494 29054 tablet_service.cc:1514] Processing DeleteTablet for tablet 956fdf81344b4013bccb342a1de7d736 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:39 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:60956
I20260620 14:59:39.567507 28921 tablet_service.cc:1514] Processing DeleteTablet for tablet 956fdf81344b4013bccb342a1de7d736 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:39 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:48400
I20260620 14:59:39.567592 28783 tablet_service.cc:1514] Processing DeleteTablet for tablet 956fdf81344b4013bccb342a1de7d736 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:59:39 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:58014
I20260620 14:59:39.567735 28858 tablet_replica.cc:330] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: stopping tablet replica
I20260620 14:59:39.567801 28858 raft_consensus.cc:2229] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:59:39.567866 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28699
I20260620 14:59:39.567890 28858 raft_consensus.cc:2258] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:39.568197 29150 tablet_replica.cc:330] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: stopping tablet replica
I20260620 14:59:39.568377 29150 raft_consensus.cc:2229] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:39.568508 29151 tablet_replica.cc:330] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: stopping tablet replica
I20260620 14:59:39.568548 29150 raft_consensus.cc:2258] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:39.568625 29151 raft_consensus.cc:2229] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:59:39.568902 29151 raft_consensus.cc:2258] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:59:39.569048 29150 ts_tablet_manager.cc:1905] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:39.569546 29151 ts_tablet_manager.cc:1905] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:59:39.571107 29150 ts_tablet_manager.cc:1918] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:39.571223 29150 log.cc:1196] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/956fdf81344b4013bccb342a1de7d736
I20260620 14:59:39.571487 29150 ts_tablet_manager.cc:1939] T 956fdf81344b4013bccb342a1de7d736 P b0b248c7daf546108d259f591d250c5b: Deleting consensus metadata
I20260620 14:59:39.571609 29151 ts_tablet_manager.cc:1918] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:59:39.571693 29151 log.cc:1196] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/956fdf81344b4013bccb342a1de7d736
I20260620 14:59:39.571983 29151 ts_tablet_manager.cc:1939] T 956fdf81344b4013bccb342a1de7d736 P 6bf130be33164fa7b4fd84939d4cd4c4: Deleting consensus metadata
I20260620 14:59:39.572050 28647 catalog_manager.cc:4841] TS b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): tablet 956fdf81344b4013bccb342a1de7d736 (table test-table [id=0e0d382cdd514c229b50e675bf151a59]) successfully deleted
I20260620 14:59:39.572576 28648 catalog_manager.cc:4841] TS 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): tablet 956fdf81344b4013bccb342a1de7d736 (table test-table [id=0e0d382cdd514c229b50e675bf151a59]) successfully deleted
W20260620 14:59:39.574608 28646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:42537 (error 108)
I20260620 14:59:39.575014 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28854
I20260620 14:59:39.575670 28856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 14:59:39.575126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:42537 (local address 127.0.0.1:58038)
0620 14:59:39.575572 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:39.575638 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:42537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418}
W20260620 14:59:39.575843 28646 catalog_manager.cc:4584] TS 184ea7bfbf714a42a7d9bd1f68261a42 (127.12.116.129:42537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 956fdf81344b4013bccb342a1de7d736: Network error: Client connection negotiation failed: client connection to 127.12.116.129:42537: connect: Connection refused (error 111)
I20260620 14:59:39.580593 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28990
I20260620 14:59:39.585696 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 28628
I20260620 14:59:59.591825 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43039
--webserver_interface=127.12.116.190
--webserver_port=38195
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 14:59:59.688405 29153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:59.688668 29153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:59.688696 29153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:59.690107 29153 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260620 14:59:59.690173 29153 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260620 14:59:59.690188 29153 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260620 14:59:59.690200 29153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:59:59.690214 29153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:59.690229 29153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:59.690241 29153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:59:59.690254 29153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:59:59.692135 29153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=38195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:59.693121 29153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:59.693742 29153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 14:59:59.701936 29153 server_base.cc:1034] running on GCE node
W20260620 14:59:59.702255 29158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:59.701906 29159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:59.701906 29161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:59.703012 29153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:59.703461 29153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:59.704690 29153 hybrid_clock.cc:648] HybridClock initialized: now 1781967599704644 us; error 77 us; skew 500 ppm
Jun 20 14:59:59 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967599, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:59.708456 29153 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 14:59:59.709086 29153 webserver.cc:460] Webserver started at http://127.12.116.190:38195/ using document root <none> and password file <none>
I20260620 14:59:59.709367 29153 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:59.709441 29153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:59.711069 29153 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 14:59:59.712103 29168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:59.712419 29153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 14:59:59.712540 29153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "9ccb6d280e4243bebdb0229e454b8b95"
format_stamp: "Formatted at 2026-06-20 14:59:17 on dist-test-slave-7v06"
server_key: "1f6e61566eb79ec7a1e4573538096a40"
server_key_iv: "f41b141025a2527f0d2ed0fbbe0adee4"
server_key_version: "encryptionkey@0"
I20260620 14:59:59.712972 29153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:59.738030 29153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:59.741607 29153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:59.742396 29153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:59.747612 29153 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43039
I20260620 14:59:59.747977 29220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43039 every 8 connection(s)
I20260620 14:59:59.748080 29153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 14:59:59.748536 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29153
I20260620 14:59:59.748822 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:42537
--local_ip_for_outbound_sockets=127.12.116.129
--tserver_master_addrs=127.12.116.190:43039
--webserver_port=43181
--webserver_interface=127.12.116.129
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:59.749680 29221 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:59:59.751070 29221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap starting.
I20260620 14:59:59.765950 29221 log.cc:824] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:59.769258 29221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:59.769688 29221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Bootstrap complete.
I20260620 14:59:59.773156 29221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:59.773625 29221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ccb6d280e4243bebdb0229e454b8b95, State: Initialized, Role: FOLLOWER
I20260620 14:59:59.773851 29221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:59.774091 29221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 14:59:59.774173 29221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 14:59:59.774222 29221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:59:59.775976 29221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:59.776134 29221 leader_election.cc:302] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ccb6d280e4243bebdb0229e454b8b95; no voters:
I20260620 14:59:59.776362 29221 leader_election.cc:288] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260620 14:59:59.776466 29225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 14:59:59.776654 29221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:59:59.776731 29225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [term 3 LEADER]: Becoming Leader. State: Replica: 9ccb6d280e4243bebdb0229e454b8b95, State: Running, Role: LEADER
I20260620 14:59:59.776854 29225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } }
I20260620 14:59:59.777172 29226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9ccb6d280e4243bebdb0229e454b8b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } } }
I20260620 14:59:59.777173 29227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ccb6d280e4243bebdb0229e454b8b95. Latest consensus state: current_term: 3 leader_uuid: "9ccb6d280e4243bebdb0229e454b8b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccb6d280e4243bebdb0229e454b8b95" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43039 } } }
I20260620 14:59:59.777271 29226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:59.777278 29227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95 [sys.catalog]: This master's current role is: LEADER
I20260620 14:59:59.777534 29234 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:59:59.778504 29234 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:59:59.778640 29234 catalog_manager.cc:1259] Loaded cluster ID: 9e13348d3dff4a479390561c5d671bca
I20260620 14:59:59.778882 29234 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:59:59.779747 29234 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:59:59.780000 29234 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Loaded TSK: 0
I20260620 14:59:59.780066 29234 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ccb6d280e4243bebdb0229e454b8b95: Loaded TSK: 1
F20260620 14:59:59.780313 29234 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc6234289ad google::LogMessage::Fail() at ??:0
@ 0x7fc62342b88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc6234284de google::LogMessage::Flush() at ??:0
@ 0x7fc623429a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc625b95104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc625b92d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc62b3821cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc62b38248e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc62b382594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fc62b348c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc62b352ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc6252f60d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc6252eb954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc62614f6db start_thread at ??:0
@ 0x7fc621f2661f clone at ??:0
W20260620 14:59:59.877938 29223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:59:59.878211 29223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:59:59.878239 29223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:59:59.879648 29223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 14:59:59.879719 29223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:59:59.879752 29223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 14:59:59.881958 29223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:42537
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=43181
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 14:59:59.882332 29223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:59:59.882634 29223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:59:59.890241 29265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:59.890229 29262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:59:59.890229 29263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:59:59.890784 29223 server_base.cc:1034] running on GCE node
I20260620 14:59:59.891067 29223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:59:59.891412 29223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:59:59.892638 29223 hybrid_clock.cc:648] HybridClock initialized: now 1781967599892607 us; error 33 us; skew 500 ppm
Jun 20 14:59:59 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967599, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 14:59:59.903406 29223 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 14:59:59.904274 29223 webserver.cc:460] Webserver started at http://127.12.116.129:43181/ using document root <none> and password file <none>
I20260620 14:59:59.904639 29223 fs_manager.cc:359] Metadata directory not provided
I20260620 14:59:59.904775 29223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:59:59.907069 29223 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 14:59:59.907924 29272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:59:59.908145 29223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 14:59:59.908252 29223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "184ea7bfbf714a42a7d9bd1f68261a42"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "c2cd9b278d7e916122e9bd6ad70d2f40"
server_key_iv: "6cf411f53344edc5d41b26a81656d6a7"
server_key_version: "encryptionkey@0"
I20260620 14:59:59.908715 29223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:59:59.917438 29223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:59:59.922526 29223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:59:59.922741 29223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:59:59.923377 29223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:59:59.924131 29279 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 14:59:59.926635 29223 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 14:59:59.926751 29223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260620 14:59:59.926805 29223 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 14:59:59.927578 29223 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 14:59:59.927646 29223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260620 14:59:59.927716 29279 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap starting.
I20260620 14:59:59.938311 29223 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:42537
I20260620 14:59:59.938354 29386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:42537 every 8 connection(s)
I20260620 14:59:59.938858 29223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 14:59:59.942065 29279 log.cc:824] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Log is configured to *not* fsync() on all Append() calls
I20260620 14:59:59.945488 29279 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:59:59.945919 29279 tablet_bootstrap.cc:492] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Bootstrap complete.
I20260620 14:59:59.947268 29279 ts_tablet_manager.cc:1397] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.010s
I20260620 14:59:59.947842 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29223
I20260620 14:59:59.948170 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:35721
--local_ip_for_outbound_sockets=127.12.116.130
--tserver_master_addrs=127.12.116.190:43039
--webserver_port=32815
--webserver_interface=127.12.116.130
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 14:59:59.949106 29279 raft_consensus.cc:348] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:59.949520 29279 raft_consensus.cc:729] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 184ea7bfbf714a42a7d9bd1f68261a42, State: Initialized, Role: FOLLOWER
I20260620 14:59:59.949693 29279 consensus_queue.cc:260] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 14:59:59.950047 29279 ts_tablet_manager.cc:1428] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
W20260620 15:00:00.043591 29389 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:59:59.939752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:54615)
0620 14:59:59.939987 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0620 14:59:59.940036 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 14:59:59.940693 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:00.043294 (+102601us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":128,"threads_started":1}
W20260620 15:00:00.043922 29387 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:43039 (0 consecutive failures): Network error: Failed to ping master at 127.12.116.190:43039: Client connection negotiation failed: client connection to 127.12.116.190:43039: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 15:00:00.044319 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.044184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:54273)
0620 15:00:00.044246 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.044297 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260620 15:00:00.045972 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.045793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:53205)
0620 15:00:00.045904 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.045941 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260620 15:00:00.046195 29387 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 15:00:00.073146 29391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:00.073418 29391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:00.073449 29391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:00.075088 29391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:00.075171 29391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:00.075206 29391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:00.077315 29391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:35721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=32815
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:00.077867 29391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:00.078158 29391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 15:00:00.084854 29391 server_base.cc:1034] running on GCE node
W20260620 15:00:00.084762 29398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:00.084762 29400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:00.084913 29397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:00.085278 29391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:00.085573 29391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:00.086779 29391 hybrid_clock.cc:648] HybridClock initialized: now 1781967600086731 us; error 67 us; skew 500 ppm
Jun 20 15:00:00 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967600, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:00.091607 29391 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 15:00:00.092722 29391 webserver.cc:460] Webserver started at http://127.12.116.130:32815/ using document root <none> and password file <none>
I20260620 15:00:00.093067 29391 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:00.093156 29391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:00.094795 29391 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:00.095919 29407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:00.096494 29391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:00.096863 29391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "6bf130be33164fa7b4fd84939d4cd4c4"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "fbd9111593f3cfd44d1e61c1e79848d3"
server_key_iv: "39b1006810b745c34fb2b6a1581fe6df"
server_key_version: "encryptionkey@0"
I20260620 15:00:00.097334 29391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:00.114236 29391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:00.119189 29391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:00.119731 29391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:00.120018 29391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:00.120508 29391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:00.120573 29391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:00.120632 29391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:00.120674 29391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:00.129504 29391 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:35721
I20260620 15:00:00.129617 29520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:35721 every 8 connection(s)
I20260620 15:00:00.130079 29391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:00.131604 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.131092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:38847)
0620 15:00:00.131330 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.131421 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":85,"threads_started":1}
W20260620 15:00:00.132144 29521 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:43039 (0 consecutive failures): Network error: Failed to ping master at 127.12.116.190:43039: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
I20260620 15:00:00.132694 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.132424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:54487)
0620 15:00:00.132515 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.132659 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260620 15:00:00.133845 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.133520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:50165)
0620 15:00:00.133785 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.133819 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245}
W20260620 15:00:00.134769 29521 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 15:00:00.139263 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29391
I20260620 15:00:00.139889 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:46695
--local_ip_for_outbound_sockets=127.12.116.131
--tserver_master_addrs=127.12.116.190:43039
--webserver_port=46001
--webserver_interface=127.12.116.131
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:00.242518 29524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:00.242822 29524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:00.242866 29524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:00.244282 29524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:00.244386 29524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:00.244441 29524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:00.246160 29524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:46695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=46001
--tserver_master_addrs=127.12.116.190:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:00.246490 29524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:00.246786 29524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:00.252888 29532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:00.252887 29529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:00.252893 29530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:00.252936 29524 server_base.cc:1034] running on GCE node
I20260620 15:00:00.253386 29524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:00.253748 29524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:00.254992 29524 hybrid_clock.cc:648] HybridClock initialized: now 1781967600254929 us; error 81 us; skew 500 ppm
Jun 20 15:00:00 dist-test-slave-7v06 krb5kdc[28081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967600, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:00.258566 29524 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 15:00:00.259094 29524 webserver.cc:460] Webserver started at http://127.12.116.131:46001/ using document root <none> and password file <none>
I20260620 15:00:00.259408 29524 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:00.259470 29524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:00.261811 29524 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:00.262753 29539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:00.263136 29524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:00.263233 29524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "b0b248c7daf546108d259f591d250c5b"
format_stamp: "Formatted at 2026-06-20 14:59:18 on dist-test-slave-7v06"
server_key: "2ba0a98df6e0b9d5e89d308ddbe9aa20"
server_key_iv: "1179af7a680d906a64267afd99d46cbb"
server_key_version: "encryptionkey@0"
I20260620 15:00:00.263689 29524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:00.277583 29524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:00.280419 29524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:00.280555 29524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:00.280772 29524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:00.281133 29524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:00.281193 29524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:00.281240 29524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:00.281265 29524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:00.288610 29524 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:46695
I20260620 15:00:00.288782 29652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:46695 every 8 connection(s)
I20260620 15:00:00.289170 29524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:00.290665 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.290148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:36865)
0620 15:00:00.290390 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.290486 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":92,"threads_started":1}
W20260620 15:00:00.291246 29653 heartbeater.cc:644] Failed to heartbeat to 127.12.116.190:43039 (0 consecutive failures): Network error: Failed to ping master at 127.12.116.190:43039: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
I20260620 15:00:00.291616 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.291506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:46431)
0620 15:00:00.291561 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.291595 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260620 15:00:00.291975 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:00.291875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:51559)
0620 15:00:00.291936 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:00.291958 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260620 15:00:00.292145 29653 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 15:00:00.297209 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29524
I20260620 15:00:01.047115 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.046776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:44061)
0620 15:00:01.046980 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:01.047031 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":71,"threads_started":1}
I20260620 15:00:01.115276 29658 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:01.115486 29658 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 15:00:01.116101 29658 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
Jun 20 15:00:01 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967599, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.131@KRBTEST.COM
Jun 20 15:00:01 dist-test-slave-7v06 krb5kdc[28081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967599, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.130@KRBTEST.COM
I20260620 15:00:01.129607 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.116624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:35721 (local address 127.12.116.129:42075)
0620 15:00:01.116820 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:01.116833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:01.116948 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:01.117883 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:01.117887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:01.118346 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:01.118671 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:01.118706 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.120199 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.120200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:01.121173 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:01.121177 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.121952 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.121955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:01.122126 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:01.122782 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:01.122792 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:01.125247 (+ 2455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:01.128106 (+ 2859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:01.128108 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:01.128108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:01.128324 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:01.128665 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:01.128666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:01.128667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:01.128757 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:01.129260 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:01.129261 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:01.129307 (+ 46us) client_negotiation.cc:769] Sending connection context
0620 15:00:01.129368 (+ 61us) client_negotiation.cc:240] Negotiation successful
0620 15:00:01.129477 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":3,"thread_start_us":117,"threads_started":1}
I20260620 15:00:01.129607 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.116260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:46695 (local address 127.12.116.129:54039)
0620 15:00:01.116344 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:01.116357 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:01.116421 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:01.117919 (+ 1498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:01.117920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:01.118359 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:01.118672 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:01.118681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.120084 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.120085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:01.121173 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:01.121177 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.122008 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.122009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:01.122122 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:01.122831 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:01.122837 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:01.124870 (+ 2033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:01.127373 (+ 2503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:01.127387 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:01.127391 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:01.127688 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:01.127990 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:01.127991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:01.127991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:01.128124 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:01.128897 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:01.128905 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:01.129077 (+ 172us) client_negotiation.cc:769] Sending connection context
0620 15:00:01.129185 (+ 108us) client_negotiation.cc:240] Negotiation successful
0620 15:00:01.129395 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":26}
I20260620 15:00:01.130249 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.116466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:54039 (local address 127.12.116.131:46695)
0620 15:00:01.116723 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:01.116741 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:01.116782 (+ 41us) server_negotiation.cc:407] Connection header received
0620 15:00:01.117626 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:01.117630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:01.117693 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:01.117906 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:01.118828 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.119787 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.121297 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.121761 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.122052 (+ 291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:01.125072 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:01.125078 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:01.125079 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:01.125093 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:01.127234 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:01.127811 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:01.127815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:01.127815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:01.127915 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:01.128206 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:01.128207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:01.128207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:01.128767 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:01.128921 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:01.129751 (+ 830us) server_negotiation.cc:299] Negotiation successful
0620 15:00:01.130171 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":89,"threads_started":1}
I20260620 15:00:01.130498 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.116612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:42075 (local address 127.12.116.130:35721)
0620 15:00:01.116790 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:01.116808 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:01.116978 (+ 170us) server_negotiation.cc:407] Connection header received
0620 15:00:01.117527 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:01.117530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:01.117594 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:01.117757 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:01.118851 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.119820 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.121315 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:01.121755 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:01.121888 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:01.125390 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:01.125395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:01.125395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:01.125409 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:01.127957 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:01.128475 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:01.128478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:01.128478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:01.128584 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:01.128837 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:01.128838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:01.128838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:01.129178 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:01.129264 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:01.129618 (+ 354us) server_negotiation.cc:299] Negotiation successful
0620 15:00:01.130380 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
W20260620 15:00:01.131201 29275 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
W20260620 15:00:01.131963 29276 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
I20260620 15:00:01.132056 29276 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42; no voters: 6bf130be33164fa7b4fd84939d4cd4c4, b0b248c7daf546108d259f591d250c5b
I20260620 15:00:01.132184 29658 raft_consensus.cc:2726] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 15:00:01.136896 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.136207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:39031)
0620 15:00:01.136729 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:01.136809 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":457,"threads_started":1}
I20260620 15:00:01.292827 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:01.292598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:60225)
0620 15:00:01.292709 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:01.292761 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":61,"threads_started":1}
I20260620 15:00:02.048180 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:02.047897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:51887)
0620 15:00:02.048090 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:02.048128 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260620 15:00:02.138386 29665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:02.138095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:43015)
0620 15:00:02.138284 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:02.138333 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":77,"threads_started":1}
I20260620 15:00:02.294255 29666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:02.293916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:45559)
0620 15:00:02.294164 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:02.294205 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":120,"threads_started":1}
I20260620 15:00:02.747175 29667 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:02.747295 29667 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 15:00:02.747514 29667 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
W20260620 15:00:02.748011 29276 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
W20260620 15:00:02.748100 29275 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
I20260620 15:00:02.748211 29275 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42; no voters: 6bf130be33164fa7b4fd84939d4cd4c4, b0b248c7daf546108d259f591d250c5b
I20260620 15:00:02.748368 29667 raft_consensus.cc:2726] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 15:00:03.049154 29668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:03.048813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:37795)
0620 15:00:03.049042 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:03.049100 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
I20260620 15:00:03.139496 29669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:03.139165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:39757)
0620 15:00:03.139371 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:03.139421 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260620 15:00:03.296227 29670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:03.295470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:50429)
0620 15:00:03.296021 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:03.296174 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":104,"threads_started":1}
I20260620 15:00:04.050302 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:04.049998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:54957)
0620 15:00:04.050204 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:04.050253 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":104,"threads_started":1}
I20260620 15:00:04.140739 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:04.140444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:58521)
0620 15:00:04.140634 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:04.140684 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":96,"threads_started":1}
I20260620 15:00:04.297235 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:04.296924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:53457)
0620 15:00:04.297129 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:04.297183 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20260620 15:00:04.726788 29674 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:04.726913 29674 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 15:00:04.727181 29674 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
W20260620 15:00:04.727747 29275 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
W20260620 15:00:04.727900 29276 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
I20260620 15:00:04.727944 29276 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42; no voters: 6bf130be33164fa7b4fd84939d4cd4c4, b0b248c7daf546108d259f591d250c5b
I20260620 15:00:04.728073 29674 raft_consensus.cc:2726] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 15:00:05.051558 29675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:05.051096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:43045)
0620 15:00:05.051426 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:05.051482 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":206,"threads_started":1}
I20260620 15:00:05.142673 29676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:05.141957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:44727)
0620 15:00:05.142229 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:05.142597 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":82,"threads_started":1}
I20260620 15:00:05.298185 29677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:05.297909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:37113)
0620 15:00:05.298086 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:05.298137 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":68,"threads_started":1}
I20260620 15:00:06.052675 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:06.052303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:60733)
0620 15:00:06.052538 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:06.052594 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":165,"threads_started":1}
I20260620 15:00:06.143894 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:06.143563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:51881)
0620 15:00:06.143765 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:06.143821 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":91,"threads_started":1}
I20260620 15:00:06.299319 29680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:06.298875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:56237)
0620 15:00:06.299136 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:06.299217 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260620 15:00:07.054152 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:07.053871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:51507)
0620 15:00:07.054036 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:07.054077 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260620 15:00:07.144979 29682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:07.144679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:49277)
0620 15:00:07.144873 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:07.144923 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":85,"threads_started":1}
I20260620 15:00:07.300655 29683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:07.300217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:53609)
0620 15:00:07.300537 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:07.300601 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":263,"threads_started":1}
I20260620 15:00:07.962528 29684 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:07.962694 29684 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 15:00:07.963222 29684 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
W20260620 15:00:07.964005 29276 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
W20260620 15:00:07.964145 29275 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
I20260620 15:00:07.964211 29275 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42; no voters: 6bf130be33164fa7b4fd84939d4cd4c4, b0b248c7daf546108d259f591d250c5b
I20260620 15:00:07.964357 29684 raft_consensus.cc:2726] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 15:00:08.055320 29685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:08.055034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:54053)
0620 15:00:08.055221 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:08.055269 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260620 15:00:08.146289 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:08.145728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:46039)
0620 15:00:08.145950 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:08.146013 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":82,"threads_started":1}
I20260620 15:00:08.301601 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:08.301305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:57923)
0620 15:00:08.301451 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:08.301501 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260620 15:00:09.056550 29688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:09.056091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:52579)
0620 15:00:09.056441 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:09.056497 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":172,"threads_started":1}
I20260620 15:00:09.147281 29689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:09.146977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:45381)
0620 15:00:09.147172 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:09.147229 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":67,"threads_started":1}
I20260620 15:00:09.303146 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:09.302824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:35207)
0620 15:00:09.303045 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:09.303091 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":95,"threads_started":1}
I20260620 15:00:10.057878 29691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:10.057387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:49369)
0620 15:00:10.057582 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:10.057808 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":115,"threads_started":1}
I20260620 15:00:10.148659 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:10.148128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:49991)
0620 15:00:10.148434 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:10.148549 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":127,"threads_started":1}
I20260620 15:00:10.304222 29693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:10.303798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:40599)
0620 15:00:10.304071 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:10.304151 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":71,"threads_started":1}
I20260620 15:00:10.563300 29694 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:10.563467 29694 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 15:00:10.563738 29694 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
W20260620 15:00:10.564673 29276 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
W20260620 15:00:10.564929 29275 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
I20260620 15:00:10.565064 29275 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42; no voters: 6bf130be33164fa7b4fd84939d4cd4c4, b0b248c7daf546108d259f591d250c5b
I20260620 15:00:10.565207 29694 raft_consensus.cc:2726] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 15:00:11.059443 29695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:11.059022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:56231)
0620 15:00:11.059301 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:11.059376 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":104,"threads_started":1}
I20260620 15:00:11.150007 29696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:11.149567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:43627)
0620 15:00:11.149821 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:11.149911 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":115,"threads_started":1}
I20260620 15:00:11.305369 29697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:11.305104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:52289)
0620 15:00:11.305272 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:11.305313 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260620 15:00:12.060715 29698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:12.060437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:47619)
0620 15:00:12.060577 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:12.060631 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260620 15:00:12.151230 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:12.150865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:53215)
0620 15:00:12.151101 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:12.151177 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":89,"threads_started":1}
I20260620 15:00:12.306442 29700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:12.306139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:59227)
0620 15:00:12.306342 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:12.306392 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":87,"threads_started":1}
I20260620 15:00:13.061743 29701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:13.061435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:36887)
0620 15:00:13.061629 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:13.061690 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":83,"threads_started":1}
I20260620 15:00:13.152359 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:13.152012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:53001)
0620 15:00:13.152193 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:13.152241 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260620 15:00:13.307471 29703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:13.307167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:55511)
0620 15:00:13.307368 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:13.307420 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":77,"threads_started":1}
I20260620 15:00:14.062794 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:14.062494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:36119)
0620 15:00:14.062684 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:14.062743 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":76,"threads_started":1}
I20260620 15:00:14.153474 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:14.153126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:52379)
0620 15:00:14.153317 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:14.153394 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":132,"threads_started":1}
I20260620 15:00:14.308471 29706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:14.308083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:50163)
0620 15:00:14.308286 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:14.308407 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":69,"threads_started":1}
I20260620 15:00:15.022393 29707 raft_consensus.cc:482] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:15.022708 29707 raft_consensus.cc:504] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bf130be33164fa7b4fd84939d4cd4c4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 35721 } } peers { permanent_uuid: "b0b248c7daf546108d259f591d250c5b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 46695 } } peers { permanent_uuid: "184ea7bfbf714a42a7d9bd1f68261a42" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 42537 } }
I20260620 15:00:15.023059 29707 leader_election.cc:288] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721), b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695)
W20260620 15:00:15.023614 29276 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bf130be33164fa7b4fd84939d4cd4c4 (127.12.116.130:35721): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
W20260620 15:00:15.024071 29275 leader_election.cc:341] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0b248c7daf546108d259f591d250c5b (127.12.116.131:46695): Not found: Tablet not found: 956fdf81344b4013bccb342a1de7d736
I20260620 15:00:15.024160 29275 leader_election.cc:302] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 184ea7bfbf714a42a7d9bd1f68261a42; no voters: 6bf130be33164fa7b4fd84939d4cd4c4, b0b248c7daf546108d259f591d250c5b
I20260620 15:00:15.024294 29707 raft_consensus.cc:2726] T 956fdf81344b4013bccb342a1de7d736 P 184ea7bfbf714a42a7d9bd1f68261a42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 15:00:15.064584 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:15.063920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.129:36797)
0620 15:00:15.064466 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:15.064529 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":185,"threads_started":1}
I20260620 15:00:15.154838 29709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:15.154504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.130:57483)
0620 15:00:15.154720 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:15.154761 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":131,"threads_started":1}
I20260620 15:00:15.306183 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 29223
I20260620 15:00:15.309682 29710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:15.309258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:43039 (local address 127.12.116.131:34779)
0620 15:00:15.309579 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:15.309630 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.190:43039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":80,"threads_started":1}
I20260620 15:00:15.311518 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 29391
I20260620 15:00:15.316581 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 29524
2026-06-20T15:00:15Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58819 ms)
[----------] 30 tests from SecurityITest (263695 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:15 dist-test-slave-7v06 krb5kdc[29713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:15 dist-test-slave-7v06 krb5kdc[29713](info): set up 2 sockets
Jun 20 15:00:15 dist-test-slave-7v06 krb5kdc[29713](info): commencing operation
krb5kdc: starting...
W20260620 15:00:16.501200 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:16 dist-test-slave-7v06 krb5kdc[29713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:16.657210 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:41527
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:41527
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:16.753767 29726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:16.754276 29726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:16.754384 29726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:16.756690 29726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:16.756843 29726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:16.756871 29726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:16.756894 29726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:16.756922 29726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:16.759776 29726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:41527
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:41527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:16.760685 29726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:16.761317 29726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:16.768761 29734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:16.768790 29732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:16.768798 29731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:16.768822 29726 server_base.cc:1034] running on GCE node
I20260620 15:00:16.769368 29726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:16.769829 29726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:16.771039 29726 hybrid_clock.cc:648] HybridClock initialized: now 1781967616770987 us; error 93 us; skew 500 ppm
Jun 20 15:00:16 dist-test-slave-7v06 krb5kdc[29713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967616, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:16.775013 29726 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:16.775866 29726 webserver.cc:460] Webserver started at http://127.12.116.190:34561/ using document root <none> and password file <none>
I20260620 15:00:16.776136 29726 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:16.776183 29726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:16.776299 29726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:16.777603 29726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "8df90871bd734b6c8e3a9b260b3ed1bb"
format_stamp: "Formatted at 2026-06-20 15:00:16 on dist-test-slave-7v06"
server_key: "a64c324130c7c6ee89872c41d4487bb4"
server_key_iv: "e1a98addb0be72ba03020418ad35b82e"
server_key_version: "encryptionkey@0"
I20260620 15:00:16.777971 29726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "8df90871bd734b6c8e3a9b260b3ed1bb"
format_stamp: "Formatted at 2026-06-20 15:00:16 on dist-test-slave-7v06"
server_key: "a64c324130c7c6ee89872c41d4487bb4"
server_key_iv: "e1a98addb0be72ba03020418ad35b82e"
server_key_version: "encryptionkey@0"
I20260620 15:00:16.780160 29726 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:16.781697 29741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:16.782261 29726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:16.782371 29726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "8df90871bd734b6c8e3a9b260b3ed1bb"
format_stamp: "Formatted at 2026-06-20 15:00:16 on dist-test-slave-7v06"
server_key: "a64c324130c7c6ee89872c41d4487bb4"
server_key_iv: "e1a98addb0be72ba03020418ad35b82e"
server_key_version: "encryptionkey@0"
I20260620 15:00:16.782447 29726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:16.792490 29726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:16.796566 29726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:16.796710 29726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:16.801563 29726 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:41527
I20260620 15:00:16.801656 29793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:41527 every 8 connection(s)
I20260620 15:00:16.802023 29726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:16.803069 29794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:16.805483 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29726
I20260620 15:00:16.805626 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:16.805891 12754 external_mini_cluster.cc:1428] Setting key 8c66186b1aedecc4a3ad066bfe62519e
I20260620 15:00:16.807263 29794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb: Bootstrap starting.
I20260620 15:00:16.808600 29794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:16.809064 29794 log.cc:824] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:16.810320 29794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb: No bootstrap required, opened a new log
I20260620 15:00:16.813025 29794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41527 } }
I20260620 15:00:16.813282 29794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:16.813328 29794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8df90871bd734b6c8e3a9b260b3ed1bb, State: Initialized, Role: FOLLOWER
I20260620 15:00:16.813488 29794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41527 } }
I20260620 15:00:16.813609 29794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:16.813659 29794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:16.813743 29794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:16.814503 29794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41527 } }
I20260620 15:00:16.814635 29794 leader_election.cc:302] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8df90871bd734b6c8e3a9b260b3ed1bb; no voters:
I20260620 15:00:16.814888 29794 leader_election.cc:288] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:16.814916 29799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:16.815079 29799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 8df90871bd734b6c8e3a9b260b3ed1bb, State: Running, Role: LEADER
I20260620 15:00:16.815264 29794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:16.815245 29799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41527 } }
Jun 20 15:00:16 dist-test-slave-7v06 krb5kdc[29713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:16.815855 29801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41527 } } }
I20260620 15:00:16.815969 29801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:16.816176 29800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8df90871bd734b6c8e3a9b260b3ed1bb. Latest consensus state: current_term: 1 leader_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8df90871bd734b6c8e3a9b260b3ed1bb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41527 } } }
I20260620 15:00:16.816567 29800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:16.817229 29808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:16.821370 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:16.806804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34764 (local address 127.12.116.190:41527)
0620 15:00:16.807031 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:16.807041 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:16.807077 (+ 36us) server_negotiation.cc:407] Connection header received
0620 15:00:16.807760 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:16.807769 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:16.807828 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:16.807989 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:16.809084 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:16.810771 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:16.812035 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:16.812943 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:16.813062 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:16.816624 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:16.816629 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:16.816630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:16.816647 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:16.818939 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:16.819590 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:16.819594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:16.819595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:16.819717 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:16.820009 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:16.820010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:16.820011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:16.820412 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:16.820590 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:16.820905 (+ 315us) server_negotiation.cc:299] Negotiation successful
0620 15:00:16.821092 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":113,"threads_started":1}
I20260620 15:00:16.821691 29808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:16.825896 29808 catalog_manager.cc:1347] Generated new cluster ID: afb2a478c5524a86b625e53a320f1a56
I20260620 15:00:16.825985 29808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:16.831079 29808 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:16.831879 29808 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:16.840296 29808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb: Generated new TSK 0
I20260620 15:00:16.840616 29808 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 15:00:16.897382 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41527
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:17.018854 29820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:17.019104 29820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:17.019135 29820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:17.021399 29820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:17.021495 29820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:17.021539 29820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 15:00:17.023490 29820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:17.023783 29820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:17.024106 29820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:17.034135 29825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:17.034509 29826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:17.035068 29820 server_base.cc:1034] running on GCE node
W20260620 15:00:17.034135 29828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:17.037559 29820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:17.038019 29820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:17.041435 29820 hybrid_clock.cc:648] HybridClock initialized: now 1781967617040982 us; error 478 us; skew 500 ppm
Jun 20 15:00:17 dist-test-slave-7v06 krb5kdc[29713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967617, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:17.045902 29820 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 15:00:17.047660 29820 webserver.cc:460] Webserver started at http://127.12.116.129:36845/ using document root <none> and password file <none>
I20260620 15:00:17.048221 29820 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:17.048405 29820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:17.048563 29820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:17.049906 29820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "87bccae8ccf94f448ac65aa54a7610a3"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "3977fdebaef30452770a504fef8f2722"
server_key_iv: "5e9449757b89aec339ca15ff00c602df"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.050336 29820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "87bccae8ccf94f448ac65aa54a7610a3"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "3977fdebaef30452770a504fef8f2722"
server_key_iv: "5e9449757b89aec339ca15ff00c602df"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.053483 29820 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260620 15:00:17.054559 29835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.055161 29820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:17.055392 29820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "87bccae8ccf94f448ac65aa54a7610a3"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "3977fdebaef30452770a504fef8f2722"
server_key_iv: "5e9449757b89aec339ca15ff00c602df"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.055507 29820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:17.074649 29820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:17.078047 29820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:17.078279 29820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:17.078616 29820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:17.079056 29820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:17.079116 29820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.079159 29820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:17.079187 29820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.088048 29820 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:38635
I20260620 15:00:17.088102 29948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:38635 every 8 connection(s)
I20260620 15:00:17.088577 29820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
Jun 20 15:00:17 dist-test-slave-7v06 krb5kdc[29713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967617, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:17.097061 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29820
I20260620 15:00:17.097196 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 15:00:17.097384 12754 external_mini_cluster.cc:1428] Setting key 135dd7c184d92e785d207a65c5a50d08
I20260620 15:00:17.103017 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.089478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:47839 (local address 127.12.116.190:41527)
0620 15:00:17.089549 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.089552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.089774 (+ 222us) server_negotiation.cc:407] Connection header received
0620 15:00:17.090365 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.090367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.090380 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.090441 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:17.091536 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.092252 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.093412 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.093660 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.093765 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.096530 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:17.096532 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:17.096533 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:17.096544 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:17.099542 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.100250 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.100252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.100252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.100906 (+ 654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.101942 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.101944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.101945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.102199 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:17.102309 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.102708 (+ 399us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.102853 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260620 15:00:17.103013 29951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.089402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41527 (local address 127.12.116.129:47839)
0620 15:00:17.089633 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.089675 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.090243 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.090538 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.090542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.091182 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:17.091409 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.091414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.092440 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.092441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.093297 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.093300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.093779 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.093780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.094027 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.094671 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:17.094681 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:17.096404 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:17.099662 (+ 3258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:17.099678 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:17.099681 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:17.100114 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:17.101067 (+ 953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:17.101068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:17.101068 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:17.101292 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:17.102360 (+ 1068us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:17.102369 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:17.102543 (+ 174us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.102650 (+ 107us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.102818 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":75,"threads_started":1}
I20260620 15:00:17.103820 29949 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41527
I20260620 15:00:17.103961 29949 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:17.104197 29949 heartbeater.cc:511] Master 127.12.116.190:41527 requested a full tablet report, sending...
I20260620 15:00:17.105422 29758 ts_manager.cc:194] Registered new tserver with Master: 87bccae8ccf94f448ac65aa54a7610a3 (127.12.116.129:38635)
I20260620 15:00:17.106287 29758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:47839
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 15:00:17.133348 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41527
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:17.255498 29954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:17.256673 29954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:17.256762 29954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:17.259009 29954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:17.259133 29954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:17.259177 29954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:17.263021 29954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:17.263334 29954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:17.263582 29954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:17.269757 29962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:17.269749 29959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:17.269925 29960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:17.269743 29954 server_base.cc:1034] running on GCE node
I20260620 15:00:17.270262 29954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:17.271080 29954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:17.272552 29954 hybrid_clock.cc:648] HybridClock initialized: now 1781967617272521 us; error 40 us; skew 500 ppm
Jun 20 15:00:17 dist-test-slave-7v06 krb5kdc[29713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967617, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:17.275725 29954 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 15:00:17.276221 29954 webserver.cc:460] Webserver started at http://127.12.116.130:39237/ using document root <none> and password file <none>
I20260620 15:00:17.276539 29954 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:17.276592 29954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:17.276747 29954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:17.278515 29954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "45abd06d849d4deea5c123707567e82d"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "c6697d3c324d343148682e7e2287cc26"
server_key_iv: "f3aab4d93b12e55d866affc475c4f294"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.279326 29954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "45abd06d849d4deea5c123707567e82d"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "c6697d3c324d343148682e7e2287cc26"
server_key_iv: "f3aab4d93b12e55d866affc475c4f294"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.281375 29954 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:17.282614 29969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.282925 29954 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:17.283025 29954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "45abd06d849d4deea5c123707567e82d"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "c6697d3c324d343148682e7e2287cc26"
server_key_iv: "f3aab4d93b12e55d866affc475c4f294"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.283164 29954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:17.303386 29954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:17.307595 29954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:17.307744 29954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:17.308095 29954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:17.308513 29954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:17.308561 29954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.308611 29954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:17.308662 29954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.315591 29954 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:42263
I20260620 15:00:17.315824 30082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:42263 every 8 connection(s)
I20260620 15:00:17.316193 29954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:17.321751 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 29954
I20260620 15:00:17.322288 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 15:00:17.322562 12754 external_mini_cluster.cc:1428] Setting key ec43571618671e1b6242045408ade60c
Jun 20 15:00:17 dist-test-slave-7v06 krb5kdc[29713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967617, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:17.329828 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.317081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:35195 (local address 127.12.116.190:41527)
0620 15:00:17.317147 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.317149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.317375 (+ 226us) server_negotiation.cc:407] Connection header received
0620 15:00:17.317994 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.317996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.318018 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.318076 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:17.319208 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.319886 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.321177 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.321417 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.321520 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.325555 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:17.325556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:17.325557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:17.325566 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:17.327346 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.328163 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.328164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.328165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.328239 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.328706 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.328707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.328708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.328886 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:17.328974 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.329570 (+ 596us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.329682 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 15:00:17.329850 30085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.317070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41527 (local address 127.12.116.130:35195)
0620 15:00:17.317239 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.317280 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.317873 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.318173 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.318177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.318829 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:17.319079 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.319085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.320021 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.320023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.321069 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.321073 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.321538 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.321539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.321678 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.322335 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:17.322347 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:17.325420 (+ 3073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:17.327485 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:17.327707 (+ 222us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:17.327715 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:17.328053 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:17.328422 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:17.328423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:17.328424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:17.328612 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:17.329086 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:17.329093 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:17.329385 (+ 292us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.329489 (+ 104us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.329657 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260620 15:00:17.330528 30083 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41527
I20260620 15:00:17.330657 30083 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:17.330875 30083 heartbeater.cc:511] Master 127.12.116.190:41527 requested a full tablet report, sending...
I20260620 15:00:17.331624 29758 ts_manager.cc:194] Registered new tserver with Master: 45abd06d849d4deea5c123707567e82d (127.12.116.130:42263)
I20260620 15:00:17.332166 29758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:35195
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 15:00:17.367473 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41527
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:17.467919 30088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:17.468225 30088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:17.468259 30088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:17.469964 30088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:17.470057 30088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:17.470090 30088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:17.472069 30088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:17.472443 30088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:17.472671 30088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:17.478957 30093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:17.478977 30096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:17.479173 30094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:17.478977 30088 server_base.cc:1034] running on GCE node
I20260620 15:00:17.479432 30088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:17.479694 30088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:17.480858 30088 hybrid_clock.cc:648] HybridClock initialized: now 1781967617480847 us; error 35 us; skew 500 ppm
Jun 20 15:00:17 dist-test-slave-7v06 krb5kdc[29713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967617, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:17.484021 30088 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 15:00:17.484628 30088 webserver.cc:460] Webserver started at http://127.12.116.131:45845/ using document root <none> and password file <none>
I20260620 15:00:17.484911 30088 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:17.484985 30088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:17.485146 30088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:17.486451 30088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "658735173a8e437d8a97d1f8e4507a46"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "0517f0b3090dbd2d7e4dcb3065088614"
server_key_iv: "59af975e3b6051e0f660a35e83efb2d2"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.486954 30088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "658735173a8e437d8a97d1f8e4507a46"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "0517f0b3090dbd2d7e4dcb3065088614"
server_key_iv: "59af975e3b6051e0f660a35e83efb2d2"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.488636 30088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260620 15:00:17.489671 30103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.489930 30088 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:17.490093 30088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "658735173a8e437d8a97d1f8e4507a46"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "0517f0b3090dbd2d7e4dcb3065088614"
server_key_iv: "59af975e3b6051e0f660a35e83efb2d2"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.490192 30088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:17.509379 30088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:17.512533 30088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:17.513065 30088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:17.513648 30088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:17.514305 30088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:17.514498 30088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.514629 30088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:17.514665 30088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.522047 30088 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:35077
I20260620 15:00:17.522085 30216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:35077 every 8 connection(s)
I20260620 15:00:17.522459 30088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:17.525475 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30088
I20260620 15:00:17.525681 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 15:00:17.526032 12754 external_mini_cluster.cc:1428] Setting key 2f3dda99232797075467e11a4f22ac3e
Jun 20 15:00:17 dist-test-slave-7v06 krb5kdc[29713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967617, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:17.538167 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.523429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:35137 (local address 127.12.116.190:41527)
0620 15:00:17.523523 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.523526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.523588 (+ 62us) server_negotiation.cc:407] Connection header received
0620 15:00:17.524383 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.524386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.524399 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.524468 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:17.525918 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.526935 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.528832 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.529192 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.529307 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.533276 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:17.533278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:17.533279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:17.533290 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:17.535402 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.536172 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.536174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.536175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.536311 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.537138 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.537140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.537140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.537308 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:17.537398 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.537887 (+ 489us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.538040 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260620 15:00:17.538470 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.523245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41527 (local address 127.12.116.131:35137)
0620 15:00:17.523427 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.523476 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.524128 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.524713 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.524717 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.525453 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:17.525728 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.525735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.527077 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.527078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.528666 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.528676 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.529391 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.529393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.529576 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.530555 (+ 979us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:17.530572 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:17.532890 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:17.535564 (+ 2674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:17.535579 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:17.535582 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:17.535959 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:17.536663 (+ 704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:17.536664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:17.536664 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:17.536835 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:17.537452 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:17.537461 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:17.537649 (+ 188us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.537847 (+ 198us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.538151 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260620 15:00:17.539149 30217 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41527
I20260620 15:00:17.539260 30217 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:17.539630 30217 heartbeater.cc:511] Master 127.12.116.190:41527 requested a full tablet report, sending...
I20260620 15:00:17.540191 29758 ts_manager.cc:194] Registered new tserver with Master: 658735173a8e437d8a97d1f8e4507a46 (127.12.116.131:35077)
I20260620 15:00:17.540666 29758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:35137
I20260620 15:00:17.549993 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 15:00:17.560976 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.551691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34768 (local address 127.12.116.190:41527)
0620 15:00:17.551779 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.551784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.551891 (+ 107us) server_negotiation.cc:407] Connection header received
0620 15:00:17.551944 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.551945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.551955 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.552014 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:17.552770 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.553301 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.554130 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.554392 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.554478 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.556859 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:17.556862 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:17.556862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:17.556873 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:17.558754 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.559289 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.559290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.559290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.559370 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:17.559728 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:17.559729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:17.559729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:17.559959 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:17.560096 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.560682 (+ 586us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.560895 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260620 15:00:17.563804 29758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 15:00:17.566293 29758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 15:00:17.575089 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.570416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42263 (local address 127.0.0.1:49462)
0620 15:00:17.570735 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.570746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.570800 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.571256 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.571256 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.571258 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:17.571303 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.571304 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.572767 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.572769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.573920 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.573923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.574726 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.574727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.574816 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.574832 (+ 16us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.574926 (+ 94us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.574992 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":77,"threads_started":1}
I20260620 15:00:17.575103 30232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.570777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49462 (local address 127.12.116.130:42263)
0620 15:00:17.570993 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.570997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.571007 (+ 10us) server_negotiation.cc:407] Connection header received
0620 15:00:17.571057 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.571060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.571074 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.571375 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:17.571445 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.572646 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.574042 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.574623 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.574727 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.574796 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.574956 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.575012 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":119,"threads_started":1}
I20260620 15:00:17.575352 30229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.570225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:38635 (local address 127.0.0.1:52152)
0620 15:00:17.570367 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.570378 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.570432 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.571152 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.571155 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.571158 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:17.571260 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.571262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.572737 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.572737 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.574101 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.574104 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.575117 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.575118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.575183 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.575187 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.575218 (+ 31us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.575265 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":102,"thread_start_us":82,"threads_started":1}
I20260620 15:00:17.575922 30231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.570679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52152 (local address 127.12.116.129:38635)
0620 15:00:17.570925 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.570931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.570944 (+ 13us) server_negotiation.cc:407] Connection header received
0620 15:00:17.571006 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.571009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.571027 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.571346 (+ 319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:17.571425 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.572618 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.574227 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.575024 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.575647 (+ 623us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.575725 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.575755 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.575811 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":78,"threads_started":1}
I20260620 15:00:17.576263 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.569925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:35077 (local address 127.0.0.1:57656)
0620 15:00:17.570263 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.570314 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.570407 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.571589 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.571590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.571593 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:17.571651 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.571653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.572680 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.572681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.574902 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.574905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.576006 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.576008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.576093 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.576097 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.576150 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.576195 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":834,"thread_start_us":126,"threads_started":1}
I20260620 15:00:17.576256 30017 tablet_service.cc:1467] Processing CreateTablet for tablet 958cbc19b76d4af89b88d9af95f17eb9 (DEFAULT_TABLE table=test-table [id=99292253594f4c62acc2ebd80397237e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:17.576618 30233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.570077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57656 (local address 127.12.116.131:35077)
0620 15:00:17.571403 (+ 1326us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.571410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.571427 (+ 17us) server_negotiation.cc:407] Connection header received
0620 15:00:17.571459 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.571461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.571473 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.571589 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:17.571738 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.572566 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.575032 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.575817 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.575890 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.575958 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.576450 (+ 492us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.576507 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1295,"thread_start_us":1198,"threads_started":1}
I20260620 15:00:17.576769 30017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958cbc19b76d4af89b88d9af95f17eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:17.577381 30151 tablet_service.cc:1467] Processing CreateTablet for tablet 958cbc19b76d4af89b88d9af95f17eb9 (DEFAULT_TABLE table=test-table [id=99292253594f4c62acc2ebd80397237e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:17.577788 30151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958cbc19b76d4af89b88d9af95f17eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:17.580926 30234 tablet_bootstrap.cc:492] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Bootstrap starting.
I20260620 15:00:17.581262 29883 tablet_service.cc:1467] Processing CreateTablet for tablet 958cbc19b76d4af89b88d9af95f17eb9 (DEFAULT_TABLE table=test-table [id=99292253594f4c62acc2ebd80397237e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:17.581651 29883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958cbc19b76d4af89b88d9af95f17eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:17.581753 30234 tablet_bootstrap.cc:654] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:17.582317 30234 log.cc:824] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:17.583913 30234 tablet_bootstrap.cc:492] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: No bootstrap required, opened a new log
I20260620 15:00:17.584051 30234 ts_tablet_manager.cc:1397] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 15:00:17.585194 30236 tablet_bootstrap.cc:492] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3: Bootstrap starting.
I20260620 15:00:17.586476 30236 tablet_bootstrap.cc:654] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:17.586503 30237 tablet_bootstrap.cc:492] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Bootstrap starting.
I20260620 15:00:17.587301 30236 log.cc:824] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:17.587636 30237 tablet_bootstrap.cc:654] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:17.587666 30234 raft_consensus.cc:348] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.587937 30234 raft_consensus.cc:374] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:17.587988 30234 raft_consensus.cc:729] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45abd06d849d4deea5c123707567e82d, State: Initialized, Role: FOLLOWER
I20260620 15:00:17.588160 30234 consensus_queue.cc:260] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.588289 30237 log.cc:824] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:17.588423 30236 tablet_bootstrap.cc:492] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3: No bootstrap required, opened a new log
I20260620 15:00:17.588503 30236 ts_tablet_manager.cc:1397] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:17.588553 30083 heartbeater.cc:503] Master 127.12.116.190:41527 was elected leader, sending a full tablet report...
I20260620 15:00:17.588551 30234 ts_tablet_manager.cc:1428] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260620 15:00:17.589228 30237 tablet_bootstrap.cc:492] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: No bootstrap required, opened a new log
I20260620 15:00:17.589283 30237 ts_tablet_manager.cc:1397] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 15:00:17.590728 30236 raft_consensus.cc:348] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.590878 30236 raft_consensus.cc:374] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:17.590899 30236 raft_consensus.cc:729] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87bccae8ccf94f448ac65aa54a7610a3, State: Initialized, Role: FOLLOWER
I20260620 15:00:17.591014 30236 consensus_queue.cc:260] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.591275 30236 ts_tablet_manager.cc:1428] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:17.591378 29949 heartbeater.cc:503] Master 127.12.116.190:41527 was elected leader, sending a full tablet report...
I20260620 15:00:17.591244 30237 raft_consensus.cc:348] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.591446 30237 raft_consensus.cc:374] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:17.591500 30237 raft_consensus.cc:729] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658735173a8e437d8a97d1f8e4507a46, State: Initialized, Role: FOLLOWER
I20260620 15:00:17.591624 30237 consensus_queue.cc:260] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.591923 30237 ts_tablet_manager.cc:1428] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:17.592067 30217 heartbeater.cc:503] Master 127.12.116.190:41527 was elected leader, sending a full tablet report...
I20260620 15:00:17.643573 30241 raft_consensus.cc:482] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:17.643893 30241 raft_consensus.cc:504] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.644676 30241 leader_election.cc:288] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658735173a8e437d8a97d1f8e4507a46 (127.12.116.131:35077), 45abd06d849d4deea5c123707567e82d (127.12.116.130:42263)
I20260620 15:00:17.649226 30233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.645294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:45741 (local address 127.12.116.131:35077)
0620 15:00:17.645382 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.645384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.645614 (+ 230us) server_negotiation.cc:407] Connection header received
0620 15:00:17.645663 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.645664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.645676 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.645758 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:17.645949 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.646461 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.647665 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.648440 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.648557 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.648570 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.649112 (+ 542us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.649159 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260620 15:00:17.649281 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.645079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:35077 (local address 127.12.116.129:45741)
0620 15:00:17.645396 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.645409 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.645535 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.645766 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.645767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.645770 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:17.645864 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.645867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.646577 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.646578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.647548 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.647552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.648779 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.648780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.648866 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.648874 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.649099 (+ 225us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.649162 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":164,"threads_started":1}
I20260620 15:00:17.649981 30171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "958cbc19b76d4af89b88d9af95f17eb9" candidate_uuid: "87bccae8ccf94f448ac65aa54a7610a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658735173a8e437d8a97d1f8e4507a46" is_pre_election: true
I20260620 15:00:17.650102 30232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.645570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:46205 (local address 127.12.116.130:42263)
0620 15:00:17.645690 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.645693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.645867 (+ 174us) server_negotiation.cc:407] Connection header received
0620 15:00:17.645968 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.645970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.645980 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.646104 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:17.646293 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.646956 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.648776 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.649548 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.649700 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.649709 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.649979 (+ 270us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.650035 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260620 15:00:17.650198 30171 raft_consensus.cc:2454] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87bccae8ccf94f448ac65aa54a7610a3 in term 0.
I20260620 15:00:17.650342 30244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.645443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:42263 (local address 127.12.116.129:46205)
0620 15:00:17.645761 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.645781 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:17.645881 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:17.646126 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:17.646127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:17.646129 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:17.646207 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.646210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.647099 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.647101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.648470 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:17.648473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.649735 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.649737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:17.649890 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.649897 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 15:00:17.650154 (+ 257us) client_negotiation.cc:240] Negotiation successful
0620 15:00:17.650240 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":250,"threads_started":1}
I20260620 15:00:17.650548 29836 leader_election.cc:302] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658735173a8e437d8a97d1f8e4507a46, 87bccae8ccf94f448ac65aa54a7610a3; no voters:
I20260620 15:00:17.650861 30241 raft_consensus.cc:2781] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 15:00:17.651039 30241 raft_consensus.cc:482] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 15:00:17.651072 30241 raft_consensus.cc:3037] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:17.651073 30037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "958cbc19b76d4af89b88d9af95f17eb9" candidate_uuid: "87bccae8ccf94f448ac65aa54a7610a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45abd06d849d4deea5c123707567e82d" is_pre_election: true
I20260620 15:00:17.651378 30037 raft_consensus.cc:2454] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87bccae8ccf94f448ac65aa54a7610a3 in term 0.
I20260620 15:00:17.652614 30241 raft_consensus.cc:504] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.652962 30241 leader_election.cc:288] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [CANDIDATE]: Term 1 election: Requested vote from peers 658735173a8e437d8a97d1f8e4507a46 (127.12.116.131:35077), 45abd06d849d4deea5c123707567e82d (127.12.116.130:42263)
I20260620 15:00:17.653308 30171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "958cbc19b76d4af89b88d9af95f17eb9" candidate_uuid: "87bccae8ccf94f448ac65aa54a7610a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658735173a8e437d8a97d1f8e4507a46"
I20260620 15:00:17.653434 30171 raft_consensus.cc:3037] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:17.653676 30037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "958cbc19b76d4af89b88d9af95f17eb9" candidate_uuid: "87bccae8ccf94f448ac65aa54a7610a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45abd06d849d4deea5c123707567e82d"
I20260620 15:00:17.653772 30037 raft_consensus.cc:3037] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:17.654577 30171 raft_consensus.cc:2454] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87bccae8ccf94f448ac65aa54a7610a3 in term 1.
I20260620 15:00:17.654803 30037 raft_consensus.cc:2454] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87bccae8ccf94f448ac65aa54a7610a3 in term 1.
I20260620 15:00:17.654983 29836 leader_election.cc:302] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658735173a8e437d8a97d1f8e4507a46, 87bccae8ccf94f448ac65aa54a7610a3; no voters:
I20260620 15:00:17.655233 30241 raft_consensus.cc:2781] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:17.655457 30241 raft_consensus.cc:686] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [term 1 LEADER]: Becoming Leader. State: Replica: 87bccae8ccf94f448ac65aa54a7610a3, State: Running, Role: LEADER
I20260620 15:00:17.655602 30241 consensus_queue.cc:237] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } }
I20260620 15:00:17.657191 29757 catalog_manager.cc:5495] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87bccae8ccf94f448ac65aa54a7610a3 (127.12.116.129). New cstate: current_term: 1 leader_uuid: "87bccae8ccf94f448ac65aa54a7610a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87bccae8ccf94f448ac65aa54a7610a3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 } health_report { overall_health: UNKNOWN } } }
I20260620 15:00:17.672977 30231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.670253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52158 (local address 127.12.116.129:38635)
0620 15:00:17.670346 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.670349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.670359 (+ 10us) server_negotiation.cc:407] Connection header received
0620 15:00:17.670411 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.670412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.670433 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.670537 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:17.670717 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.671241 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.672058 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.672278 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.672390 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.672606 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:17.672726 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:17.672832 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.672851 (+ 19us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.672876 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260620 15:00:17.676471 30037 raft_consensus.cc:1261] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 1 FOLLOWER]: Refusing update from remote peer 87bccae8ccf94f448ac65aa54a7610a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:17.676471 30171 raft_consensus.cc:1261] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 1 FOLLOWER]: Refusing update from remote peer 87bccae8ccf94f448ac65aa54a7610a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:17.677596 30241 consensus_queue.cc:1035] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45abd06d849d4deea5c123707567e82d" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:17.677861 30245 consensus_queue.cc:1035] T 958cbc19b76d4af89b88d9af95f17eb9 P 87bccae8ccf94f448ac65aa54a7610a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658735173a8e437d8a97d1f8e4507a46" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:17.682271 30250 mvcc.cc:205] Tried to move back new op lower bound from 7298939361996185600 to 7298939361918365696. Current Snapshot: MvccSnapshot[applied={T|T < 7298939361996185600}]
I20260620 15:00:17.683480 30249 mvcc.cc:205] Tried to move back new op lower bound from 7298939361996185600 to 7298939361918365696. Current Snapshot: MvccSnapshot[applied={T|T < 7298939361996185600 or (T in {7298939361996185600})}]
I20260620 15:00:17.683730 29757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:17.683858 29757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:17.684726 29757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8df90871bd734b6c8e3a9b260b3ed1bb: Sending DeleteTablet for 3 replicas of tablet 958cbc19b76d4af89b88d9af95f17eb9
I20260620 15:00:17.685159 30151 tablet_service.cc:1514] Processing DeleteTablet for tablet 958cbc19b76d4af89b88d9af95f17eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:17 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:57656
I20260620 15:00:17.685220 30017 tablet_service.cc:1514] Processing DeleteTablet for tablet 958cbc19b76d4af89b88d9af95f17eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:17 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:49462
I20260620 15:00:17.685501 29883 tablet_service.cc:1514] Processing DeleteTablet for tablet 958cbc19b76d4af89b88d9af95f17eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:17 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:52152
I20260620 15:00:17.685851 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 29820
I20260620 15:00:17.687592 30258 tablet_replica.cc:330] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: stopping tablet replica
I20260620 15:00:17.687933 30258 raft_consensus.cc:2229] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:17.688508 30258 raft_consensus.cc:2258] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:17.689311 30258 ts_tablet_manager.cc:1905] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:17.692492 30258 ts_tablet_manager.cc:1918] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:17.692601 30258 log.cc:1196] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/958cbc19b76d4af89b88d9af95f17eb9
I20260620 15:00:17.693192 30258 ts_tablet_manager.cc:1939] T 958cbc19b76d4af89b88d9af95f17eb9 P 45abd06d849d4deea5c123707567e82d: Deleting consensus metadata
W20260620 15:00:17.693320 29742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:38635 (error 108)
I20260620 15:00:17.693888 30257 tablet_replica.cc:330] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: stopping tablet replica
I20260620 15:00:17.694072 30257 raft_consensus.cc:2229] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:17.694233 29742 catalog_manager.cc:4841] TS 45abd06d849d4deea5c123707567e82d (127.12.116.130:42263): tablet 958cbc19b76d4af89b88d9af95f17eb9 (table test-table [id=99292253594f4c62acc2ebd80397237e]) successfully deleted
I20260620 15:00:17.694583 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.694137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:38635 (local address 127.0.0.1:52170)
0620 15:00:17.694209 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:17.694275 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 15:00:17.694648 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 29954
W20260620 15:00:17.694841 29742 catalog_manager.cc:4584] TS 87bccae8ccf94f448ac65aa54a7610a3 (127.12.116.129:38635): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 958cbc19b76d4af89b88d9af95f17eb9: Network error: Client connection negotiation failed: client connection to 127.12.116.129:38635: connect: Connection refused (error 111)
I20260620 15:00:17.697356 30257 raft_consensus.cc:2258] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:17.701274 30257 ts_tablet_manager.cc:1905] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:17.705173 30257 ts_tablet_manager.cc:1918] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:17.705302 30257 log.cc:1196] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/958cbc19b76d4af89b88d9af95f17eb9
I20260620 15:00:17.705696 30257 ts_tablet_manager.cc:1939] T 958cbc19b76d4af89b88d9af95f17eb9 P 658735173a8e437d8a97d1f8e4507a46: Deleting consensus metadata
I20260620 15:00:17.706087 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30088
I20260620 15:00:17.712081 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 29726
2026-06-20T15:00:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2392 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-06-20T15:00:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:17Z Disabled control of system clock
I20260620 15:00:17.748735 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:33237
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:33237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:17.855135 30264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:17.855667 30264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:17.855700 30264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:17.857376 30264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:17.857467 30264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:17.857482 30264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:17.857498 30264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:17.857511 30264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:17.859531 30264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:33237
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:33237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:17.859809 30264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:17.860136 30264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:17.866091 30270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:17.866128 30272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:17.866452 30264 server_base.cc:1034] running on GCE node
W20260620 15:00:17.866096 30269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:17.866816 30264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:17.867197 30264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:17.868446 30264 hybrid_clock.cc:648] HybridClock initialized: now 1781967617868403 us; error 64 us; skew 500 ppm
I20260620 15:00:17.870224 30264 webserver.cc:460] Webserver started at http://127.12.116.190:44219/ using document root <none> and password file <none>
I20260620 15:00:17.870534 30264 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:17.870613 30264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:17.870777 30264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:17.871984 30264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "25ae9b4a41264334ab8c9f486239066b"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "9a545fec8ebc4042c4da84de8324b432"
server_key_iv: "13b32312ff78c5453e79ebae56e723eb"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.872496 30264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "25ae9b4a41264334ab8c9f486239066b"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "9a545fec8ebc4042c4da84de8324b432"
server_key_iv: "13b32312ff78c5453e79ebae56e723eb"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.874119 30264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:17.875087 30278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:17.875313 30264 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:17.875433 30264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "25ae9b4a41264334ab8c9f486239066b"
format_stamp: "Formatted at 2026-06-20 15:00:17 on dist-test-slave-7v06"
server_key: "9a545fec8ebc4042c4da84de8324b432"
server_key_iv: "13b32312ff78c5453e79ebae56e723eb"
server_key_version: "encryptionkey@0"
I20260620 15:00:17.875533 30264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:17.891438 30264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:17.891844 30264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:17.892022 30264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:17.899634 30264 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:33237
I20260620 15:00:17.899675 30330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:33237 every 8 connection(s)
I20260620 15:00:17.900557 30264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:17.901726 30331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:17.906054 30331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b: Bootstrap starting.
I20260620 15:00:17.906226 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30264
I20260620 15:00:17.906498 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:17.906785 12754 external_mini_cluster.cc:1428] Setting key b07e75c6a4966a68eef0aef4a90e9e18
I20260620 15:00:17.907155 30331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:17.907610 30331 log.cc:824] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:17.908699 30331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b: No bootstrap required, opened a new log
I20260620 15:00:17.910984 30331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ae9b4a41264334ab8c9f486239066b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33237 } }
I20260620 15:00:17.911268 30331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:17.911315 30331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ae9b4a41264334ab8c9f486239066b, State: Initialized, Role: FOLLOWER
I20260620 15:00:17.911468 30331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ae9b4a41264334ab8c9f486239066b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33237 } }
I20260620 15:00:17.911579 30331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:17.911613 30331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:17.911656 30331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:17.912611 30331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ae9b4a41264334ab8c9f486239066b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33237 } }
I20260620 15:00:17.912736 30331 leader_election.cc:302] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25ae9b4a41264334ab8c9f486239066b; no voters:
I20260620 15:00:17.913015 30331 leader_election.cc:288] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:17.913144 30336 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:17.913357 30336 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [term 1 LEADER]: Becoming Leader. State: Replica: 25ae9b4a41264334ab8c9f486239066b, State: Running, Role: LEADER
I20260620 15:00:17.913419 30331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:17.913535 30336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ae9b4a41264334ab8c9f486239066b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33237 } }
I20260620 15:00:17.913928 30338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25ae9b4a41264334ab8c9f486239066b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ae9b4a41264334ab8c9f486239066b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33237 } } }
I20260620 15:00:17.913911 30336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25ae9b4a41264334ab8c9f486239066b. Latest consensus state: current_term: 1 leader_uuid: "25ae9b4a41264334ab8c9f486239066b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ae9b4a41264334ab8c9f486239066b" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33237 } } }
I20260620 15:00:17.914013 30338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:17.914021 30336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:17.916942 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:17.907585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57432 (local address 127.12.116.190:33237)
0620 15:00:17.907962 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:17.907975 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:17.908026 (+ 51us) server_negotiation.cc:407] Connection header received
0620 15:00:17.908765 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:17.908776 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:17.908869 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:17.909022 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:17.909646 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.910957 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.912206 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:17.912896 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:17.913071 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:17.913952 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:17.913956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:17.913957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:17.914461 (+ 504us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:17.914793 (+ 332us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:17.914816 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:17.914910 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:17.915602 (+ 692us) server_negotiation.cc:299] Negotiation successful
0620 15:00:17.915766 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":107,"threads_started":1}
I20260620 15:00:17.916983 30342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:17.918386 30342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:17.921085 30342 catalog_manager.cc:1347] Generated new cluster ID: 0a61d0d140c9465c8790e6bb56aa884b
I20260620 15:00:17.921221 30342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:17.942474 30342 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:17.943138 30342 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:17.952356 30342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b: Generated new TSK 0
I20260620 15:00:17.953172 30342 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:17.956557 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33237
--builtin_ntp_servers=127.12.116.148:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:18.060583 30355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:18.060937 30355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:18.060972 30355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:18.062740 30355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:18.062816 30355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:18.062851 30355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 15:00:18.066215 30355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:18.066627 30355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:18.067065 30355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:18.075569 30361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:18.076572 30363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:18.076722 30355 server_base.cc:1034] running on GCE node
W20260620 15:00:18.077432 30360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:18.077788 30355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:18.078184 30355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:18.079406 30355 hybrid_clock.cc:648] HybridClock initialized: now 1781967618079392 us; error 33 us; skew 500 ppm
I20260620 15:00:18.081633 30355 webserver.cc:460] Webserver started at http://127.12.116.129:36611/ using document root <none> and password file <none>
I20260620 15:00:18.081962 30355 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:18.082046 30355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:18.082219 30355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:18.083489 30355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "841a667764fd41898c37226b679620f3"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "46a5f36b5b9d9aeb4bbcf335a6882fe4"
server_key_iv: "2951934004f84cc2c6c558c5d2268b3c"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.083926 30355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "841a667764fd41898c37226b679620f3"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "46a5f36b5b9d9aeb4bbcf335a6882fe4"
server_key_iv: "2951934004f84cc2c6c558c5d2268b3c"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.086992 30355 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260620 15:00:18.088313 30369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.088611 30355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:18.088744 30355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "841a667764fd41898c37226b679620f3"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "46a5f36b5b9d9aeb4bbcf335a6882fe4"
server_key_iv: "2951934004f84cc2c6c558c5d2268b3c"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.088850 30355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:18.125739 30355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:18.126147 30355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:18.126322 30355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:18.126597 30355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:18.126958 30355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:18.127110 30355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.127167 30355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:18.127183 30355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.134557 30355 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:38667
I20260620 15:00:18.134625 30482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:38667 every 8 connection(s)
I20260620 15:00:18.135059 30355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 15:00:18.136471 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30355
I20260620 15:00:18.136601 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 15:00:18.136812 12754 external_mini_cluster.cc:1428] Setting key 6c8fd94171b7b0c16196d91f8ca205ce
I20260620 15:00:18.138057 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33237
--builtin_ntp_servers=127.12.116.148:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 15:00:18.142202 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.136211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:60127 (local address 127.12.116.190:33237)
0620 15:00:18.136264 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.136267 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.136636 (+ 369us) server_negotiation.cc:407] Connection header received
0620 15:00:18.137333 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.137334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.137348 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.137414 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:18.138258 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.138791 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.140460 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.140687 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.140767 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.141860 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:18.141861 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:18.141862 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:18.141867 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:18.141884 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:18.141888 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:18.141940 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.142079 (+ 139us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.142118 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 15:00:18.142586 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.136236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:33237 (local address 127.12.116.129:60127)
0620 15:00:18.136466 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.136521 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.137220 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.137479 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.137483 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.137519 (+ 36us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:18.138118 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.138124 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.138914 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.138915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.140289 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.140294 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.140802 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.140804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.140993 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.141662 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:18.141663 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:18.141709 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:18.141744 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:18.141965 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:18.141972 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:18.141975 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.142068 (+ 93us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.142209 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":123,"threads_started":1}
I20260620 15:00:18.143289 30483 heartbeater.cc:347] Connected to a master server at 127.12.116.190:33237
I20260620 15:00:18.143419 30483 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:18.143626 30483 heartbeater.cc:511] Master 127.12.116.190:33237 requested a full tablet report, sending...
I20260620 15:00:18.144547 30295 ts_manager.cc:194] Registered new tserver with Master: 841a667764fd41898c37226b679620f3 (127.12.116.129:38667)
I20260620 15:00:18.145633 30295 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.129:60127
W20260620 15:00:18.238348 30486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:18.238660 30486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:18.238692 30486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:18.240278 30486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:18.240391 30486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:18.240428 30486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:18.242209 30486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:18.242519 30486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:18.242946 30486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:18.249742 30491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:18.249716 30494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:18.249716 30492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:18.250165 30486 server_base.cc:1034] running on GCE node
I20260620 15:00:18.250444 30486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:18.250741 30486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:18.251966 30486 hybrid_clock.cc:648] HybridClock initialized: now 1781967618251946 us; error 52 us; skew 500 ppm
I20260620 15:00:18.254366 30486 webserver.cc:460] Webserver started at http://127.12.116.130:40527/ using document root <none> and password file <none>
I20260620 15:00:18.254707 30486 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:18.254791 30486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:18.255074 30486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:18.256309 30486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "0201fb72c4bf4e4f9b6241832e1cf848"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "4b6b35f73ff3f6a8edebe1bb49bd6a7e"
server_key_iv: "affbb38a63f82363dd622ea6719cf4be"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.256830 30486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "0201fb72c4bf4e4f9b6241832e1cf848"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "4b6b35f73ff3f6a8edebe1bb49bd6a7e"
server_key_iv: "affbb38a63f82363dd622ea6719cf4be"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.258685 30486 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260620 15:00:18.259899 30500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.260267 30486 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:18.260524 30486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "0201fb72c4bf4e4f9b6241832e1cf848"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "4b6b35f73ff3f6a8edebe1bb49bd6a7e"
server_key_iv: "affbb38a63f82363dd622ea6719cf4be"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.260639 30486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:18.275131 30486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:18.275553 30486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:18.275736 30486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:18.276038 30486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:18.276522 30486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:18.276587 30486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.276674 30486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:18.276707 30486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.284264 30486 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:39629
I20260620 15:00:18.284416 30613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:39629 every 8 connection(s)
I20260620 15:00:18.285043 30486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:18.285668 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30486
I20260620 15:00:18.285785 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 15:00:18.286000 12754 external_mini_cluster.cc:1428] Setting key 61411fdd15d9dc82c7c1cb9163974054
I20260620 15:00:18.287254 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33237
--builtin_ntp_servers=127.12.116.148:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 15:00:18.294134 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.286293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:33807 (local address 127.12.116.190:33237)
0620 15:00:18.286344 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.286346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.286651 (+ 305us) server_negotiation.cc:407] Connection header received
0620 15:00:18.287699 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.287701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.287716 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.287810 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:18.289351 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.289911 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.291920 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.292181 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.292286 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.293637 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:18.293639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:18.293640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:18.293647 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:18.293672 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:18.293678 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:18.293754 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.293986 (+ 232us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.294026 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 15:00:18.294418 30616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.286161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:33237 (local address 127.12.116.130:33807)
0620 15:00:18.286497 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.286548 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.287491 (+ 943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.287912 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.287917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.287932 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:18.288879 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.288889 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.290149 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.290152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.291739 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.291745 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.292305 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.292306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.292590 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.293432 (+ 842us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:18.293433 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:18.293470 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:18.293505 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:18.293758 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:18.293835 (+ 77us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:18.293843 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.293986 (+ 143us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.294130 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":136,"threads_started":1}
I20260620 15:00:18.294971 30614 heartbeater.cc:347] Connected to a master server at 127.12.116.190:33237
I20260620 15:00:18.295087 30614 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:18.295318 30614 heartbeater.cc:511] Master 127.12.116.190:33237 requested a full tablet report, sending...
I20260620 15:00:18.295748 30295 ts_manager.cc:194] Registered new tserver with Master: 0201fb72c4bf4e4f9b6241832e1cf848 (127.12.116.130:39629)
I20260620 15:00:18.296196 30295 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.130:33807
W20260620 15:00:18.388204 30617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:18.388651 30617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:18.388700 30617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:18.391316 30617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:18.391538 30617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:18.391631 30617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:18.395794 30617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:18.396234 30617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:18.396801 30617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:18.404595 30625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:18.404595 30623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:18.405069 30622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:18.405252 30617 server_base.cc:1034] running on GCE node
I20260620 15:00:18.405544 30617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:18.405860 30617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:18.407122 30617 hybrid_clock.cc:648] HybridClock initialized: now 1781967618407070 us; error 65 us; skew 500 ppm
I20260620 15:00:18.409085 30617 webserver.cc:460] Webserver started at http://127.12.116.131:39681/ using document root <none> and password file <none>
I20260620 15:00:18.409390 30617 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:18.409473 30617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:18.409653 30617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:18.410868 30617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "80d7c5fb172041f1a2b0350a4c609d9f"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "2b0f47dc4916c9f77e3277f89db8c37b"
server_key_iv: "a3d9b94b0c464754d1d841a6496ca2fb"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.411312 30617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "80d7c5fb172041f1a2b0350a4c609d9f"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "2b0f47dc4916c9f77e3277f89db8c37b"
server_key_iv: "a3d9b94b0c464754d1d841a6496ca2fb"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.413069 30617 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:18.415259 30631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.416141 30617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 15:00:18.416630 30617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "80d7c5fb172041f1a2b0350a4c609d9f"
format_stamp: "Formatted at 2026-06-20 15:00:18 on dist-test-slave-7v06"
server_key: "2b0f47dc4916c9f77e3277f89db8c37b"
server_key_iv: "a3d9b94b0c464754d1d841a6496ca2fb"
server_key_version: "encryptionkey@0"
I20260620 15:00:18.416980 30617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:18.428711 30617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:18.429083 30617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:18.429217 30617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:18.429440 30617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:18.429838 30617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:18.429904 30617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.429952 30617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:18.429980 30617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:18.440368 30617 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:39199
I20260620 15:00:18.440416 30744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:39199 every 8 connection(s)
I20260620 15:00:18.440841 30617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:18.446961 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30617
I20260620 15:00:18.447074 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 15:00:18.447309 12754 external_mini_cluster.cc:1428] Setting key 01256df6633ce3dd54185dd2b792e951
I20260620 15:00:18.448671 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.442319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:57249 (local address 127.12.116.190:33237)
0620 15:00:18.442514 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.442517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.442757 (+ 240us) server_negotiation.cc:407] Connection header received
0620 15:00:18.443581 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.443582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.443599 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.443678 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:18.444722 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.445277 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.446499 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.446773 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.446870 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.448211 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:18.448214 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:18.448215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:18.448221 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:18.448241 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:18.448247 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:18.448309 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.448537 (+ 228us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.448573 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260620 15:00:18.449028 30747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.442029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:33237 (local address 127.12.116.131:57249)
0620 15:00:18.442522 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.442611 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.443377 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.443765 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.443772 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.443787 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:18.444536 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.444544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.445455 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.445456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.446370 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.446372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.446912 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.446914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.447110 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.447905 (+ 795us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:18.447906 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:18.447957 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:18.447994 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:18.448375 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:18.448383 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:18.448387 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.448504 (+ 117us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.448627 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
I20260620 15:00:18.449854 30745 heartbeater.cc:347] Connected to a master server at 127.12.116.190:33237
I20260620 15:00:18.449980 30745 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:18.450210 30745 heartbeater.cc:511] Master 127.12.116.190:33237 requested a full tablet report, sending...
I20260620 15:00:18.450801 30295 ts_manager.cc:194] Registered new tserver with Master: 80d7c5fb172041f1a2b0350a4c609d9f (127.12.116.131:39199)
I20260620 15:00:18.451432 30295 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.131:57249
I20260620 15:00:18.460999 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 15:00:18.468647 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.464729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57436 (local address 127.12.116.190:33237)
0620 15:00:18.464858 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.464861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.464874 (+ 13us) server_negotiation.cc:407] Connection header received
0620 15:00:18.464911 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.464912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.464925 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.464990 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:18.465214 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.465928 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.467097 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.467349 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.467441 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.468261 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:18.468263 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:18.468263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:18.468270 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:18.468287 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:18.468292 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:18.468424 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.468500 (+ 76us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.468537 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260620 15:00:18.471081 30295 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 15:00:18.473255 30295 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 15:00:18.487007 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.480204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:39629 (local address 127.0.0.1:39528)
0620 15:00:18.480544 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.480555 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.480616 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.480870 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.480873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.480875 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:18.481705 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.481709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.484292 (+ 2583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.484293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.485599 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.485604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.486615 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.486727 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.486745 (+ 18us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.486831 (+ 86us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.486902 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":79,"thread_start_us":96,"threads_started":1}
I20260620 15:00:18.487149 30758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.480259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:38667 (local address 127.0.0.1:42800)
0620 15:00:18.480698 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.480710 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.480785 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.481056 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.481056 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.481059 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:18.481118 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.481120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.484273 (+ 3153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.484274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.485876 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.485880 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.486853 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.486938 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.486944 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.487014 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.487065 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":151,"thread_start_us":106,"threads_started":1}
I20260620 15:00:18.487392 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.480002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:39199 (local address 127.0.0.1:51772)
0620 15:00:18.480435 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.480526 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.480616 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.480961 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.480962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.480964 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:18.481053 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.481055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.484260 (+ 3205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.484261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.485907 (+ 1646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.485908 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.486961 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.487033 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.487040 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.487247 (+ 207us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.487315 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":325,"thread_start_us":91,"threads_started":1}
I20260620 15:00:18.487579 30761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.480442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.12.116.130:39629)
0620 15:00:18.480626 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.480630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.480645 (+ 15us) server_negotiation.cc:407] Connection header received
0620 15:00:18.480750 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.480753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.480772 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.480859 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:18.482160 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.484197 (+ 2037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.485716 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.486441 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486534 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.486644 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.487355 (+ 711us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.487411 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
I20260620 15:00:18.487730 30757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.480095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51772 (local address 127.12.116.131:39199)
0620 15:00:18.480508 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.480514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.480706 (+ 192us) server_negotiation.cc:407] Connection header received
0620 15:00:18.480785 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.480788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.480807 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.480885 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:18.481405 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.484141 (+ 2736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486007 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.486768 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486844 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.486925 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.487578 (+ 653us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.487637 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":97,"threads_started":1}
I20260620 15:00:18.488138 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.480403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42800 (local address 127.12.116.129:38667)
0620 15:00:18.480626 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.480631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.480824 (+ 193us) server_negotiation.cc:407] Connection header received
0620 15:00:18.480891 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.480894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.480909 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.480982 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:18.481201 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.483943 (+ 2742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.485992 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.486753 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.486852 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.486938 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.487032 (+ 94us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.487078 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":92,"threads_started":1}
I20260620 15:00:18.488543 30679 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5cdd520a304f5593d0838821c8cf41 (DEFAULT_TABLE table=test-table [id=f9a3f6841816493b8d8c5d6943aa6711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:18.488665 30548 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5cdd520a304f5593d0838821c8cf41 (DEFAULT_TABLE table=test-table [id=f9a3f6841816493b8d8c5d6943aa6711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:18.488859 30417 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5cdd520a304f5593d0838821c8cf41 (DEFAULT_TABLE table=test-table [id=f9a3f6841816493b8d8c5d6943aa6711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:18.488999 30679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5cdd520a304f5593d0838821c8cf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:18.489030 30548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5cdd520a304f5593d0838821c8cf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:18.489208 30417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5cdd520a304f5593d0838821c8cf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:18.492614 30762 tablet_bootstrap.cc:492] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Bootstrap starting.
I20260620 15:00:18.493193 30763 tablet_bootstrap.cc:492] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: Bootstrap starting.
I20260620 15:00:18.493527 30762 tablet_bootstrap.cc:654] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:18.493868 30763 tablet_bootstrap.cc:654] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:18.493932 30762 log.cc:824] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:18.494227 30763 log.cc:824] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:18.494642 30764 tablet_bootstrap.cc:492] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Bootstrap starting.
I20260620 15:00:18.494983 30762 tablet_bootstrap.cc:492] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: No bootstrap required, opened a new log
I20260620 15:00:18.495057 30762 ts_tablet_manager.cc:1397] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 15:00:18.495285 30763 tablet_bootstrap.cc:492] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: No bootstrap required, opened a new log
I20260620 15:00:18.495425 30764 tablet_bootstrap.cc:654] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:18.495431 30763 ts_tablet_manager.cc:1397] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:18.495751 30764 log.cc:824] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:18.496692 30764 tablet_bootstrap.cc:492] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: No bootstrap required, opened a new log
I20260620 15:00:18.496771 30764 ts_tablet_manager.cc:1397] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 15:00:18.497543 30762 raft_consensus.cc:348] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.497740 30762 raft_consensus.cc:374] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:18.497788 30762 raft_consensus.cc:729] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d7c5fb172041f1a2b0350a4c609d9f, State: Initialized, Role: FOLLOWER
I20260620 15:00:18.497951 30762 consensus_queue.cc:260] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.498297 30762 ts_tablet_manager.cc:1428] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260620 15:00:18.498486 30745 heartbeater.cc:503] Master 127.12.116.190:33237 was elected leader, sending a full tablet report...
I20260620 15:00:18.498541 30763 raft_consensus.cc:348] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.498713 30763 raft_consensus.cc:374] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:18.498749 30763 raft_consensus.cc:729] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841a667764fd41898c37226b679620f3, State: Initialized, Role: FOLLOWER
I20260620 15:00:18.498873 30763 consensus_queue.cc:260] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.500587 30763 ts_tablet_manager.cc:1428] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260620 15:00:18.501959 30483 heartbeater.cc:503] Master 127.12.116.190:33237 was elected leader, sending a full tablet report...
I20260620 15:00:18.501926 30764 raft_consensus.cc:348] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.502195 30764 raft_consensus.cc:374] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:18.502254 30764 raft_consensus.cc:729] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0201fb72c4bf4e4f9b6241832e1cf848, State: Initialized, Role: FOLLOWER
I20260620 15:00:18.502453 30764 consensus_queue.cc:260] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.502856 30764 ts_tablet_manager.cc:1428] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260620 15:00:18.504034 30614 heartbeater.cc:503] Master 127.12.116.190:33237 was elected leader, sending a full tablet report...
W20260620 15:00:18.535960 30615 tablet.cc:2369] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:18.596239 30768 raft_consensus.cc:482] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:18.596442 30768 raft_consensus.cc:504] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.596777 30768 leader_election.cc:288] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841a667764fd41898c37226b679620f3 (127.12.116.129:38667), 0201fb72c4bf4e4f9b6241832e1cf848 (127.12.116.130:39629)
I20260620 15:00:18.600911 30747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.597025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:39629 (local address 127.12.116.131:34837)
0620 15:00:18.597120 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.597134 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.597182 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.597524 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.597526 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.597528 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:18.597608 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.597611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.598818 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.598819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.599694 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.599698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.600647 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.600649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.600734 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.600738 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.600793 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.600836 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260620 15:00:18.600988 30761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.597212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:34837 (local address 127.12.116.130:39629)
0620 15:00:18.597265 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.597268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.597276 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:18.597309 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.597310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.597324 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.597492 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:18.597726 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.598632 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.599833 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.600517 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.600638 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.600652 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.600833 (+ 181us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.600900 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 15:00:18.601145 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.597212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39915 (local address 127.12.116.129:38667)
0620 15:00:18.597280 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.597283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.597719 (+ 436us) server_negotiation.cc:407] Connection header received
0620 15:00:18.597750 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.597751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.597765 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.597822 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:18.597959 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.598762 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.600094 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.600609 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.600702 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.600712 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.600981 (+ 269us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.601040 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 15:00:18.601332 30771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.597025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:38667 (local address 127.12.116.131:39915)
0620 15:00:18.597542 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.597554 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:18.597636 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:18.597831 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:18.597832 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:18.597833 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:18.597884 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.597885 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.598896 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.598898 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.599932 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:18.599935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.600801 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.600802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:18.600882 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.600887 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 15:00:18.600961 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 15:00:18.601250 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":15,"thread_start_us":112,"threads_started":1}
I20260620 15:00:18.601388 30568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5cdd520a304f5593d0838821c8cf41" candidate_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" is_pre_election: true
I20260620 15:00:18.601588 30568 raft_consensus.cc:2454] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d7c5fb172041f1a2b0350a4c609d9f in term 0.
I20260620 15:00:18.601800 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5cdd520a304f5593d0838821c8cf41" candidate_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841a667764fd41898c37226b679620f3" is_pre_election: true
I20260620 15:00:18.601847 30632 leader_election.cc:302] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0201fb72c4bf4e4f9b6241832e1cf848, 80d7c5fb172041f1a2b0350a4c609d9f; no voters:
I20260620 15:00:18.601969 30437 raft_consensus.cc:2454] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d7c5fb172041f1a2b0350a4c609d9f in term 0.
I20260620 15:00:18.602015 30768 raft_consensus.cc:2781] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 15:00:18.602114 30768 raft_consensus.cc:482] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 15:00:18.602150 30768 raft_consensus.cc:3037] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:18.602913 30768 raft_consensus.cc:504] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.603122 30768 leader_election.cc:288] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [CANDIDATE]: Term 1 election: Requested vote from peers 841a667764fd41898c37226b679620f3 (127.12.116.129:38667), 0201fb72c4bf4e4f9b6241832e1cf848 (127.12.116.130:39629)
I20260620 15:00:18.603497 30568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5cdd520a304f5593d0838821c8cf41" candidate_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0201fb72c4bf4e4f9b6241832e1cf848"
I20260620 15:00:18.603463 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5cdd520a304f5593d0838821c8cf41" candidate_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841a667764fd41898c37226b679620f3"
I20260620 15:00:18.603646 30437 raft_consensus.cc:3037] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:18.603645 30568 raft_consensus.cc:3037] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:18.604979 30568 raft_consensus.cc:2454] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d7c5fb172041f1a2b0350a4c609d9f in term 1.
I20260620 15:00:18.604982 30437 raft_consensus.cc:2454] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d7c5fb172041f1a2b0350a4c609d9f in term 1.
I20260620 15:00:18.605293 30633 leader_election.cc:302] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d7c5fb172041f1a2b0350a4c609d9f, 841a667764fd41898c37226b679620f3; no voters:
I20260620 15:00:18.605477 30768 raft_consensus.cc:2781] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:18.605669 30768 raft_consensus.cc:686] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 1 LEADER]: Becoming Leader. State: Replica: 80d7c5fb172041f1a2b0350a4c609d9f, State: Running, Role: LEADER
I20260620 15:00:18.605801 30768 consensus_queue.cc:237] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } }
I20260620 15:00:18.606968 30295 catalog_manager.cc:5495] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d7c5fb172041f1a2b0350a4c609d9f (127.12.116.131). New cstate: current_term: 1 leader_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d7c5fb172041f1a2b0350a4c609d9f" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 39199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 } health_report { overall_health: UNKNOWN } } }
W20260620 15:00:18.635952 30484 tablet.cc:2369] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:18.638569 30757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.634215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51788 (local address 127.12.116.131:39199)
0620 15:00:18.634381 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:18.634384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:18.634394 (+ 10us) server_negotiation.cc:407] Connection header received
0620 15:00:18.634444 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:18.634445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:18.634464 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:18.634538 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:18.634700 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.635242 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.636802 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:18.637045 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:18.637159 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:18.637599 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:18.637754 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:18.637863 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:18.638319 (+ 456us) server_negotiation.cc:299] Negotiation successful
0620 15:00:18.638427 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260620 15:00:18.643903 30437 raft_consensus.cc:1261] T 4f5cdd520a304f5593d0838821c8cf41 P 841a667764fd41898c37226b679620f3 [term 1 FOLLOWER]: Refusing update from remote peer 80d7c5fb172041f1a2b0350a4c609d9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:18.643723 30568 raft_consensus.cc:1261] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 1 FOLLOWER]: Refusing update from remote peer 80d7c5fb172041f1a2b0350a4c609d9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:18.645009 30772 consensus_queue.cc:1035] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0201fb72c4bf4e4f9b6241832e1cf848" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:18.645201 30768 consensus_queue.cc:1035] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "841a667764fd41898c37226b679620f3" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:18.648522 30775 mvcc.cc:205] Tried to move back new op lower bound from 7298939365953671168 to 7298939365810081792. Current Snapshot: MvccSnapshot[applied={T|T < 7298939365953671168}]
I20260620 15:00:18.649055 30776 mvcc.cc:205] Tried to move back new op lower bound from 7298939365953671168 to 7298939365810081792. Current Snapshot: MvccSnapshot[applied={T|T < 7298939365953671168}]
I20260620 15:00:18.649549 30777 mvcc.cc:205] Tried to move back new op lower bound from 7298939365953671168 to 7298939365810081792. Current Snapshot: MvccSnapshot[applied={T|T < 7298939365953671168 or (T in {7298939365953671168})}]
I20260620 15:00:18.651643 30295 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:18.651815 30295 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:18.652957 30295 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25ae9b4a41264334ab8c9f486239066b: Sending DeleteTablet for 3 replicas of tablet 4f5cdd520a304f5593d0838821c8cf41
I20260620 15:00:18.653322 30679 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5cdd520a304f5593d0838821c8cf41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:18 UTC) from {username='slave'} at 127.0.0.1:51772
I20260620 15:00:18.653355 30417 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5cdd520a304f5593d0838821c8cf41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:18 UTC) from {username='slave'} at 127.0.0.1:42800
I20260620 15:00:18.653355 30548 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5cdd520a304f5593d0838821c8cf41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:18 UTC) from {username='slave'} at 127.0.0.1:39528
I20260620 15:00:18.653710 30787 tablet_replica.cc:330] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: stopping tablet replica
I20260620 15:00:18.653792 30785 tablet_replica.cc:330] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: stopping tablet replica
I20260620 15:00:18.653841 30787 raft_consensus.cc:2229] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:18.653968 30787 raft_consensus.cc:2258] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:18.653975 30785 raft_consensus.cc:2229] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 1 LEADER]: Raft consensus shutting down.
I20260620 15:00:18.654069 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30355
I20260620 15:00:18.659353 30785 raft_consensus.cc:2258] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:18.660297 30787 ts_tablet_manager.cc:1905] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:18.663676 30787 ts_tablet_manager.cc:1918] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:18.664060 30787 log.cc:1196] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/4f5cdd520a304f5593d0838821c8cf41
I20260620 15:00:18.664690 30787 ts_tablet_manager.cc:1939] T 4f5cdd520a304f5593d0838821c8cf41 P 0201fb72c4bf4e4f9b6241832e1cf848: Deleting consensus metadata
I20260620 15:00:18.665338 30279 catalog_manager.cc:4841] TS 0201fb72c4bf4e4f9b6241832e1cf848 (127.12.116.130:39629): tablet 4f5cdd520a304f5593d0838821c8cf41 (table test-table [id=f9a3f6841816493b8d8c5d6943aa6711]) successfully deleted
I20260620 15:00:18.665486 30785 ts_tablet_manager.cc:1905] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 15:00:18.666460 30280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:38667 (error 108)
I20260620 15:00:18.666769 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30486
I20260620 15:00:18.668187 30785 ts_tablet_manager.cc:1918] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:18.668280 30785 log.cc:1196] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/4f5cdd520a304f5593d0838821c8cf41
I20260620 15:00:18.668409 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:18.668235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:38667 (local address 127.0.0.1:42816)
0620 15:00:18.668291 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:18.668350 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:38667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260620 15:00:18.668538 30280 catalog_manager.cc:4584] TS 841a667764fd41898c37226b679620f3 (127.12.116.129:38667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4f5cdd520a304f5593d0838821c8cf41: Network error: Client connection negotiation failed: client connection to 127.12.116.129:38667: connect: Connection refused (error 111)
I20260620 15:00:18.668581 30785 ts_tablet_manager.cc:1939] T 4f5cdd520a304f5593d0838821c8cf41 P 80d7c5fb172041f1a2b0350a4c609d9f: Deleting consensus metadata
I20260620 15:00:18.669205 30280 catalog_manager.cc:4841] TS 80d7c5fb172041f1a2b0350a4c609d9f (127.12.116.131:39199): tablet 4f5cdd520a304f5593d0838821c8cf41 (table test-table [id=f9a3f6841816493b8d8c5d6943aa6711]) successfully deleted
I20260620 15:00:18.672973 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30617
I20260620 15:00:18.680189 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30264
2026-06-20T15:00:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (971 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:18 dist-test-slave-7v06 krb5kdc[30791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:18 dist-test-slave-7v06 krb5kdc[30791](info): set up 2 sockets
Jun 20 15:00:18 dist-test-slave-7v06 krb5kdc[30791](info): commencing operation
krb5kdc: starting...
W20260620 15:00:19.872781 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:19 dist-test-slave-7v06 krb5kdc[30791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:20.048007 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37787
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:37787
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:20.185631 30804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:20.185914 30804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:20.185941 30804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:20.187515 30804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:20.187592 30804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:20.187608 30804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:20.187620 30804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:20.187633 30804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:20.189538 30804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:37787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:37787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:20.189881 30804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:20.190191 30804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:20.197053 30809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.197053 30810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.197324 30812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:20.198060 30804 server_base.cc:1034] running on GCE node
I20260620 15:00:20.198628 30804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:20.199110 30804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:20.200498 30804 hybrid_clock.cc:648] HybridClock initialized: now 1781967620200458 us; error 42 us; skew 500 ppm
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:20.211424 30804 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:20.212052 30804 webserver.cc:460] Webserver started at http://127.12.116.190:38951/ using document root <none> and password file <none>
I20260620 15:00:20.212436 30804 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:20.212538 30804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:20.212723 30804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:20.213984 30804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "494088d5d7d449098d1a42e92a1030b5"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "d4b8bc5ea3d1db3177e9bb9b9d1f06d7"
server_key_iv: "24d2fde90d74a482177649c6c1302d52"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.214401 30804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "494088d5d7d449098d1a42e92a1030b5"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "d4b8bc5ea3d1db3177e9bb9b9d1f06d7"
server_key_iv: "24d2fde90d74a482177649c6c1302d52"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.216961 30804 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:20.218237 30819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.218870 30804 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:20.219153 30804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "494088d5d7d449098d1a42e92a1030b5"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "d4b8bc5ea3d1db3177e9bb9b9d1f06d7"
server_key_iv: "24d2fde90d74a482177649c6c1302d52"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.219314 30804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:20.244572 30804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:20.249689 30804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:20.249954 30804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:20.257243 30804 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:37787
I20260620 15:00:20.257779 30804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:20.258072 30871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:37787 every 8 connection(s)
I20260620 15:00:20.258663 30872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:20.261545 30872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5: Bootstrap starting.
I20260620 15:00:20.262327 30872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:20.262753 30872 log.cc:824] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:20.263820 30872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5: No bootstrap required, opened a new log
I20260620 15:00:20.266933 30872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "494088d5d7d449098d1a42e92a1030b5" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37787 } }
I20260620 15:00:20.267247 30872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:20.267277 30872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 494088d5d7d449098d1a42e92a1030b5, State: Initialized, Role: FOLLOWER
I20260620 15:00:20.267594 30872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "494088d5d7d449098d1a42e92a1030b5" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37787 } }
I20260620 15:00:20.267673 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30804
I20260620 15:00:20.267737 30872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:20.267788 30872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:20.267810 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:20.267851 30872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:20.268501 12754 external_mini_cluster.cc:1428] Setting key fe92967489fbf11b5dc391b1b7352cfd
I20260620 15:00:20.271593 30872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "494088d5d7d449098d1a42e92a1030b5" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37787 } }
I20260620 15:00:20.271803 30872 leader_election.cc:302] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 494088d5d7d449098d1a42e92a1030b5; no voters:
I20260620 15:00:20.272238 30872 leader_election.cc:288] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:20.272320 30877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:20.272688 30877 raft_consensus.cc:686] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [term 1 LEADER]: Becoming Leader. State: Replica: 494088d5d7d449098d1a42e92a1030b5, State: Running, Role: LEADER
I20260620 15:00:20.272926 30877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "494088d5d7d449098d1a42e92a1030b5" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37787 } }
I20260620 15:00:20.273161 30872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:20.274024 30878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "494088d5d7d449098d1a42e92a1030b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "494088d5d7d449098d1a42e92a1030b5" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37787 } } }
I20260620 15:00:20.274173 30878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:20.274418 30879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 494088d5d7d449098d1a42e92a1030b5. Latest consensus state: current_term: 1 leader_uuid: "494088d5d7d449098d1a42e92a1030b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "494088d5d7d449098d1a42e92a1030b5" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 37787 } } }
I20260620 15:00:20.274492 30879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:20.274959 30886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:20.276708 30886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:20.279297 30886 catalog_manager.cc:1347] Generated new cluster ID: 35eb090928e642cd9a945c813732c3cd
I20260620 15:00:20.279453 30886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:20.287541 30876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:20.270694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.12.116.190:37787)
0620 15:00:20.270977 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:20.270988 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:20.271022 (+ 34us) server_negotiation.cc:407] Connection header received
0620 15:00:20.271158 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:20.271165 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:20.271228 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:20.271356 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:20.272786 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.275022 (+ 2236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.276793 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.277453 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.277634 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:20.281931 (+ 4297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:20.281938 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:20.281939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:20.281959 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:20.284911 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:20.285896 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:20.285902 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:20.285902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:20.286088 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:20.286376 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:20.286377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:20.286377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:20.286765 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:20.286945 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:20.287099 (+ 154us) server_negotiation.cc:299] Negotiation successful
0620 15:00:20.287275 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":169,"threads_started":1}
I20260620 15:00:20.302743 30886 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:20.305367 30886 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:20.317662 30886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5: Generated new TSK 0
I20260620 15:00:20.319996 30886 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 15:00:20.374979 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37787
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:20.507004 30898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:20.507441 30898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:20.507577 30898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:20.509994 30898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:20.510146 30898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:20.510215 30898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 15:00:20.512123 30898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:20.512497 30898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:20.512794 30898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:20.518874 30904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.518867 30903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.518867 30906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:20.519326 30898 server_base.cc:1034] running on GCE node
I20260620 15:00:20.519595 30898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:20.519884 30898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:20.521083 30898 hybrid_clock.cc:648] HybridClock initialized: now 1781967620521060 us; error 44 us; skew 500 ppm
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:20.524550 30898 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 15:00:20.525632 30898 webserver.cc:460] Webserver started at http://127.12.116.129:43685/ using document root <none> and password file <none>
I20260620 15:00:20.525923 30898 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:20.526000 30898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:20.526171 30898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:20.527354 30898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "ccab3b928b531586969f7b7362de6533"
server_key_iv: "5c73b14d6d00c162eb5e131ac644ea5b"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.527777 30898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "ccab3b928b531586969f7b7362de6533"
server_key_iv: "5c73b14d6d00c162eb5e131ac644ea5b"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.529606 30898 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:20.530978 30913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.531250 30898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:20.531363 30898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "ccab3b928b531586969f7b7362de6533"
server_key_iv: "5c73b14d6d00c162eb5e131ac644ea5b"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.531445 30898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:20.543628 30898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:20.547600 30898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:20.547796 30898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:20.548692 30898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:20.549665 30898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:20.549742 30898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.549772 30898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:20.549786 30898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.560844 30898 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:37481
I20260620 15:00:20.560907 31026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:37481 every 8 connection(s)
I20260620 15:00:20.561271 30898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 15:00:20.563716 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 30898
I20260620 15:00:20.563820 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 15:00:20.564152 12754 external_mini_cluster.cc:1428] Setting key e68111b8a1793facbcb5515948f44f19
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:20.577157 30876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:20.562088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:35323 (local address 127.12.116.190:37787)
0620 15:00:20.562155 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:20.562167 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:20.562460 (+ 293us) server_negotiation.cc:407] Connection header received
0620 15:00:20.563076 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:20.563078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:20.563094 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:20.563175 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:20.564823 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.565574 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.566809 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.567176 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.567270 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:20.572604 (+ 5334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:20.572607 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:20.572608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:20.572626 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:20.575189 (+ 2563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:20.575803 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:20.575805 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:20.575806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:20.575879 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:20.576189 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:20.576190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:20.576191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:20.576394 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:20.576464 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:20.576831 (+ 367us) server_negotiation.cc:299] Negotiation successful
0620 15:00:20.576943 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 15:00:20.577396 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:20.562005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37787 (local address 127.12.116.129:35323)
0620 15:00:20.562202 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:20.562248 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:20.562845 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:20.563320 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:20.563323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:20.564310 (+ 987us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:20.564688 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:20.564695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.565796 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.565797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:20.566696 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:20.566700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.567434 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.567435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:20.567854 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:20.569551 (+ 1697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:20.569567 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:20.572433 (+ 2866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:20.575310 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:20.575327 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:20.575330 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:20.575705 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:20.575959 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:20.575960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:20.575960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:20.576101 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:20.576471 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:20.576481 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:20.576661 (+ 180us) client_negotiation.cc:769] Sending connection context
0620 15:00:20.576791 (+ 130us) client_negotiation.cc:240] Negotiation successful
0620 15:00:20.577092 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
I20260620 15:00:20.578455 31027 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37787
I20260620 15:00:20.578583 31027 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:20.578840 31027 heartbeater.cc:511] Master 127.12.116.190:37787 requested a full tablet report, sending...
I20260620 15:00:20.579849 30836 ts_manager.cc:194] Registered new tserver with Master: bf42890bd0fc4e49aa2c88e3ed7c08a4 (127.12.116.129:37481)
I20260620 15:00:20.580958 30836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:35323
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 15:00:20.606786 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37787
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:20.712397 31032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:20.712872 31032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:20.712908 31032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:20.714525 31032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:20.714591 31032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:20.714632 31032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:20.716976 31032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:20.717258 31032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:20.717478 31032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:20.724445 31040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.724438 31037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.724438 31038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:20.725178 31032 server_base.cc:1034] running on GCE node
I20260620 15:00:20.725514 31032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:20.725852 31032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:20.727075 31032 hybrid_clock.cc:648] HybridClock initialized: now 1781967620727013 us; error 81 us; skew 500 ppm
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:20.730244 31032 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 15:00:20.731218 31032 webserver.cc:460] Webserver started at http://127.12.116.130:45761/ using document root <none> and password file <none>
I20260620 15:00:20.731518 31032 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:20.731575 31032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:20.731720 31032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:20.733091 31032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "e11646ec06b34bd4917bd638be9614f4"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "b3a97809980f6a64ed8988a174c55bd3"
server_key_iv: "a815b6f86119003c968f6091b38906df"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.733491 31032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "e11646ec06b34bd4917bd638be9614f4"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "b3a97809980f6a64ed8988a174c55bd3"
server_key_iv: "a815b6f86119003c968f6091b38906df"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.735561 31032 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 15:00:20.737251 31047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.738456 31032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 15:00:20.738610 31032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "e11646ec06b34bd4917bd638be9614f4"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "b3a97809980f6a64ed8988a174c55bd3"
server_key_iv: "a815b6f86119003c968f6091b38906df"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.738734 31032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:20.777878 31032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:20.780579 31032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:20.780759 31032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:20.781139 31032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:20.781545 31032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:20.781610 31032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.781656 31032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:20.781682 31032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.789422 31032 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:43541
I20260620 15:00:20.789561 31160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:43541 every 8 connection(s)
I20260620 15:00:20.790135 31032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:20.794834 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31032
I20260620 15:00:20.794941 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 15:00:20.795307 12754 external_mini_cluster.cc:1428] Setting key 99835223b225404ec7a3a28b5eef71f9
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:20.802904 30876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:20.791273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:49745 (local address 127.12.116.190:37787)
0620 15:00:20.791355 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:20.791358 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:20.791706 (+ 348us) server_negotiation.cc:407] Connection header received
0620 15:00:20.792247 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:20.792249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:20.792260 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:20.792372 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:20.793520 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.794053 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.795340 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.795641 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.795749 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:20.799025 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:20.799028 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:20.799029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:20.799049 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:20.801060 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:20.801613 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:20.801615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:20.801616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:20.801695 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:20.802107 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:20.802109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:20.802109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:20.802290 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:20.802377 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:20.802682 (+ 305us) server_negotiation.cc:299] Negotiation successful
0620 15:00:20.802788 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 15:00:20.803036 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:20.791248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37787 (local address 127.12.116.130:49745)
0620 15:00:20.791568 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:20.791612 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:20.792146 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:20.792533 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:20.792537 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:20.793169 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:20.793399 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:20.793403 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.794218 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.794219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:20.795246 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:20.795249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:20.795765 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:20.795766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:20.795895 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:20.796652 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:20.796665 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:20.798892 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:20.801205 (+ 2313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:20.801217 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:20.801220 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:20.801511 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:20.801880 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:20.801882 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:20.801882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:20.802021 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:20.802376 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:20.802382 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:20.802533 (+ 151us) client_negotiation.cc:769] Sending connection context
0620 15:00:20.802639 (+ 106us) client_negotiation.cc:240] Negotiation successful
0620 15:00:20.802797 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":126,"threads_started":1}
I20260620 15:00:20.803653 31161 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37787
I20260620 15:00:20.803797 31161 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:20.804016 31161 heartbeater.cc:511] Master 127.12.116.190:37787 requested a full tablet report, sending...
I20260620 15:00:20.804615 30836 ts_manager.cc:194] Registered new tserver with Master: e11646ec06b34bd4917bd638be9614f4 (127.12.116.130:43541)
I20260620 15:00:20.805194 30836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:49745
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 15:00:20.829716 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37787
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:20.947613 31166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:20.948073 31166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:20.948182 31166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:20.951053 31166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:20.951201 31166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:20.951261 31166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:20.954030 31166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:37787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:20.954448 31166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:20.954741 31166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:20.961472 31172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:20.961515 31166 server_base.cc:1034] running on GCE node
W20260620 15:00:20.961738 31171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:20.961794 31174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:20.962061 31166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:20.962375 31166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:20.963603 31166 hybrid_clock.cc:648] HybridClock initialized: now 1781967620963578 us; error 39 us; skew 500 ppm
Jun 20 15:00:20 dist-test-slave-7v06 krb5kdc[30791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:20.967080 31166 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 15:00:20.968058 31166 webserver.cc:460] Webserver started at http://127.12.116.131:40307/ using document root <none> and password file <none>
I20260620 15:00:20.968462 31166 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:20.968549 31166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:20.968832 31166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:20.970323 31166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "e72917baf5fd424da68b540baf17b13b"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "3abffda6acddc619df5e01da34e601c6"
server_key_iv: "865b983af0f55bdeee3846143e3f6f3b"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.970778 31166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "e72917baf5fd424da68b540baf17b13b"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "3abffda6acddc619df5e01da34e601c6"
server_key_iv: "865b983af0f55bdeee3846143e3f6f3b"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.972802 31166 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:20.973984 31181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:20.974392 31166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:20.974529 31166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "e72917baf5fd424da68b540baf17b13b"
format_stamp: "Formatted at 2026-06-20 15:00:20 on dist-test-slave-7v06"
server_key: "3abffda6acddc619df5e01da34e601c6"
server_key_iv: "865b983af0f55bdeee3846143e3f6f3b"
server_key_version: "encryptionkey@0"
I20260620 15:00:20.974602 31166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:21.037009 31166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:21.039866 31166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:21.040117 31166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:21.040465 31166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:21.040889 31166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:21.040966 31166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.041014 31166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:21.041051 31166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.049697 31166 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:38635
I20260620 15:00:21.049998 31294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:38635 every 8 connection(s)
I20260620 15:00:21.050182 31166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:21.058856 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31166
I20260620 15:00:21.058974 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 15:00:21.059190 12754 external_mini_cluster.cc:1428] Setting key 1095d78c86f7ec33f5742bf01ecc2bec
Jun 20 15:00:21 dist-test-slave-7v06 krb5kdc[30791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967620, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:21.067783 30876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.051387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:34127 (local address 127.12.116.190:37787)
0620 15:00:21.051502 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.051504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.051867 (+ 363us) server_negotiation.cc:407] Connection header received
0620 15:00:21.052321 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.052322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.052424 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.052508 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:21.054568 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.055345 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.057036 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.057250 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.057320 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.062077 (+ 4757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:21.062079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:21.062079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:21.062088 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:21.064974 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:21.065957 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:21.065959 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:21.065959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:21.066036 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:21.066667 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:21.066669 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:21.066669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:21.066990 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:21.067087 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.067599 (+ 512us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.067704 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260620 15:00:21.067896 31297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.051397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:37787 (local address 127.12.116.131:34127)
0620 15:00:21.051615 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.051661 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.052193 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.052699 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.052703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.054097 (+ 1394us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:21.054352 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.054359 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.055509 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.055511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.056889 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.056893 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.057574 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.057576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.057722 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.058574 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:21.058585 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:21.061932 (+ 3347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:21.065424 (+ 3492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:21.065438 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:21.065441 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:21.065819 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:21.066272 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:21.066273 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:21.066273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:21.066421 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:21.067158 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:21.067166 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:21.067361 (+ 195us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.067486 (+ 125us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.067680 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":123,"threads_started":1}
I20260620 15:00:21.069331 31295 heartbeater.cc:347] Connected to a master server at 127.12.116.190:37787
I20260620 15:00:21.069464 31295 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:21.069672 31295 heartbeater.cc:511] Master 127.12.116.190:37787 requested a full tablet report, sending...
I20260620 15:00:21.070313 30836 ts_manager.cc:194] Registered new tserver with Master: e72917baf5fd424da68b540baf17b13b (127.12.116.131:38635)
I20260620 15:00:21.071412 30836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:34127
I20260620 15:00:21.072602 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 15:00:21.082921 30876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.074850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50080 (local address 127.12.116.190:37787)
0620 15:00:21.074972 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.074974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.075132 (+ 158us) server_negotiation.cc:407] Connection header received
0620 15:00:21.075217 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.075218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.075230 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.075307 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:21.076021 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.076624 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.077405 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.077606 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.077931 (+ 325us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.079706 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:21.079709 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:21.079709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:21.079719 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:21.081445 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:21.081967 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:21.081968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:21.081969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:21.082036 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:21.082274 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:21.082275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:21.082276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:21.082443 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:21.082568 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.082723 (+ 155us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.082793 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260620 15:00:21.085685 30835 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 15:00:21.089824 30835 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 15:00:21.100979 31307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.095642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43541 (local address 127.0.0.1:41944)
0620 15:00:21.095920 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.095975 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.096058 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.096628 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.096629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.096632 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:21.096696 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.096698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.098272 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.098273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.099557 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.099562 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.100571 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.100573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.100695 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.100715 (+ 20us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.100807 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.100873 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260620 15:00:21.101138 31306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.095731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:38635 (local address 127.0.0.1:52306)
0620 15:00:21.095955 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.095991 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.096062 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.096507 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.096511 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.096514 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:21.096634 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.096638 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.098257 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.098258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.099839 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.099840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.100879 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.100880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.100944 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.100952 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.100989 (+ 37us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.101053 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":154,"thread_start_us":114,"threads_started":1}
I20260620 15:00:21.101668 31309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.095918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37481 (local address 127.0.0.1:54156)
0620 15:00:21.096199 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.096209 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.096256 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.096699 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.096700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.096702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:21.096752 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.096753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.098192 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.098194 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.099835 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.099840 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.101402 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.101403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.101450 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.101454 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.101535 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.101584 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":101,"thread_start_us":73,"threads_started":1}
I20260620 15:00:21.101678 31310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.096040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54156 (local address 127.12.116.129:37481)
0620 15:00:21.096447 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.096452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.096463 (+ 11us) server_negotiation.cc:407] Connection header received
0620 15:00:21.096498 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.096500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.096517 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.096598 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:21.096843 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.098061 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.100448 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.101239 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.101321 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.101370 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.101553 (+ 183us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.101595 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":72,"threads_started":1}
I20260620 15:00:21.104213 31311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.096065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52306 (local address 127.12.116.131:38635)
0620 15:00:21.096235 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.096239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.096249 (+ 10us) server_negotiation.cc:407] Connection header received
0620 15:00:21.096287 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.096288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.096302 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.096729 (+ 427us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:21.096797 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.098044 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.099955 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.100747 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.101398 (+ 651us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.101466 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.101496 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.104028 (+ 2532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
I20260620 15:00:21.104516 31308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.095760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.12.116.130:43541)
0620 15:00:21.096431 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.096436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.096448 (+ 12us) server_negotiation.cc:407] Connection header received
0620 15:00:21.096492 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.096495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.096513 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.096786 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:21.096873 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.098004 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.099672 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.100467 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.100571 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.100637 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.100842 (+ 205us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.100898 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":94,"threads_started":1}
I20260620 15:00:21.105252 31226 tablet_service.cc:1467] Processing CreateTablet for tablet f4750b8fdbc24304b2147780edf6eadc (DEFAULT_TABLE table=test-table [id=011ce9fe2c5a4aa3b42648bdcf832aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:21.105249 30961 tablet_service.cc:1467] Processing CreateTablet for tablet f4750b8fdbc24304b2147780edf6eadc (DEFAULT_TABLE table=test-table [id=011ce9fe2c5a4aa3b42648bdcf832aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:21.105650 30961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4750b8fdbc24304b2147780edf6eadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:21.105650 31226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4750b8fdbc24304b2147780edf6eadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:21.105602 31095 tablet_service.cc:1467] Processing CreateTablet for tablet f4750b8fdbc24304b2147780edf6eadc (DEFAULT_TABLE table=test-table [id=011ce9fe2c5a4aa3b42648bdcf832aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:21.106094 31095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4750b8fdbc24304b2147780edf6eadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:21.112663 31312 tablet_bootstrap.cc:492] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Bootstrap starting.
I20260620 15:00:21.112663 31314 tablet_bootstrap.cc:492] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Bootstrap starting.
I20260620 15:00:21.112730 31313 tablet_bootstrap.cc:492] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4: Bootstrap starting.
I20260620 15:00:21.113444 31312 tablet_bootstrap.cc:654] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:21.114123 31314 tablet_bootstrap.cc:654] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:21.114130 31312 log.cc:824] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:21.114229 31313 tablet_bootstrap.cc:654] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:21.114856 31314 log.cc:824] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:21.114955 31313 log.cc:824] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:21.115531 31312 tablet_bootstrap.cc:492] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: No bootstrap required, opened a new log
I20260620 15:00:21.115658 31312 ts_tablet_manager.cc:1397] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:21.115943 31314 tablet_bootstrap.cc:492] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: No bootstrap required, opened a new log
I20260620 15:00:21.116039 31314 ts_tablet_manager.cc:1397] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:21.116251 31313 tablet_bootstrap.cc:492] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4: No bootstrap required, opened a new log
I20260620 15:00:21.116362 31313 ts_tablet_manager.cc:1397] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260620 15:00:21.118081 31314 raft_consensus.cc:348] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.118310 31314 raft_consensus.cc:374] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:21.118358 31314 raft_consensus.cc:729] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72917baf5fd424da68b540baf17b13b, State: Initialized, Role: FOLLOWER
I20260620 15:00:21.118489 31314 consensus_queue.cc:260] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.118852 31314 ts_tablet_manager.cc:1428] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:21.119004 31295 heartbeater.cc:503] Master 127.12.116.190:37787 was elected leader, sending a full tablet report...
I20260620 15:00:21.119124 31312 raft_consensus.cc:348] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.119338 31312 raft_consensus.cc:374] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:21.119382 31312 raft_consensus.cc:729] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11646ec06b34bd4917bd638be9614f4, State: Initialized, Role: FOLLOWER
I20260620 15:00:21.119513 31312 consensus_queue.cc:260] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.119849 31312 ts_tablet_manager.cc:1428] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260620 15:00:21.120004 31161 heartbeater.cc:503] Master 127.12.116.190:37787 was elected leader, sending a full tablet report...
I20260620 15:00:21.120190 31313 raft_consensus.cc:348] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.120404 31313 raft_consensus.cc:374] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:21.120450 31313 raft_consensus.cc:729] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf42890bd0fc4e49aa2c88e3ed7c08a4, State: Initialized, Role: FOLLOWER
I20260620 15:00:21.120565 31313 consensus_queue.cc:260] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.120898 31313 ts_tablet_manager.cc:1428] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260620 15:00:21.120913 31027 heartbeater.cc:503] Master 127.12.116.190:37787 was elected leader, sending a full tablet report...
I20260620 15:00:21.197769 31318 raft_consensus.cc:482] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:21.197932 31318 raft_consensus.cc:504] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.198288 31318 leader_election.cc:288] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11646ec06b34bd4917bd638be9614f4 (127.12.116.130:43541), bf42890bd0fc4e49aa2c88e3ed7c08a4 (127.12.116.129:37481)
I20260620 15:00:21.204038 31321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.198676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37481 (local address 127.12.116.131:38415)
0620 15:00:21.198846 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.198855 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.198892 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.199245 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.199247 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.199250 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:21.199369 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.199371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.200846 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.200847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.202736 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.202742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.203674 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.203676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.203771 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.203779 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.203854 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.203919 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":138,"thread_start_us":114,"threads_started":1}
I20260620 15:00:21.204110 31308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.198944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39131 (local address 127.12.116.130:43541)
0620 15:00:21.198998 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.199000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.199011 (+ 11us) server_negotiation.cc:407] Connection header received
0620 15:00:21.199060 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.199061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.199072 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.199142 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:21.199623 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.200696 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.202917 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.203531 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.203641 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.203649 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.203914 (+ 265us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.204032 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 15:00:21.204111 31310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.199020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:38415 (local address 127.12.116.129:37481)
0620 15:00:21.199103 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.199105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.199113 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:21.199140 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.199141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.199150 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.199206 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:21.199623 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.200692 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.202917 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.203531 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.203637 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.203649 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.203914 (+ 265us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.204045 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260620 15:00:21.204041 31297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.198517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43541 (local address 127.12.116.131:39131)
0620 15:00:21.198589 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.198603 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.198661 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.199245 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.199247 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.199250 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:21.199334 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.199336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.200846 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.200847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.202736 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.202742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.203674 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.203676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.203771 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.203779 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.203854 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.203919 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":92}
I20260620 15:00:21.204588 30981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4750b8fdbc24304b2147780edf6eadc" candidate_uuid: "e72917baf5fd424da68b540baf17b13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" is_pre_election: true
I20260620 15:00:21.204921 30981 raft_consensus.cc:2454] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72917baf5fd424da68b540baf17b13b in term 0.
I20260620 15:00:21.205209 31182 leader_election.cc:302] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf42890bd0fc4e49aa2c88e3ed7c08a4, e72917baf5fd424da68b540baf17b13b; no voters:
I20260620 15:00:21.205232 31115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4750b8fdbc24304b2147780edf6eadc" candidate_uuid: "e72917baf5fd424da68b540baf17b13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11646ec06b34bd4917bd638be9614f4" is_pre_election: true
I20260620 15:00:21.205363 31318 raft_consensus.cc:2781] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 15:00:21.205389 31115 raft_consensus.cc:2454] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72917baf5fd424da68b540baf17b13b in term 0.
I20260620 15:00:21.205446 31318 raft_consensus.cc:482] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 15:00:21.205489 31318 raft_consensus.cc:3037] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:21.206352 31318 raft_consensus.cc:504] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.206526 31318 leader_election.cc:288] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [CANDIDATE]: Term 1 election: Requested vote from peers e11646ec06b34bd4917bd638be9614f4 (127.12.116.130:43541), bf42890bd0fc4e49aa2c88e3ed7c08a4 (127.12.116.129:37481)
I20260620 15:00:21.206974 31115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4750b8fdbc24304b2147780edf6eadc" candidate_uuid: "e72917baf5fd424da68b540baf17b13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11646ec06b34bd4917bd638be9614f4"
I20260620 15:00:21.207000 30981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4750b8fdbc24304b2147780edf6eadc" candidate_uuid: "e72917baf5fd424da68b540baf17b13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4"
I20260620 15:00:21.207175 30981 raft_consensus.cc:3037] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:21.207062 31115 raft_consensus.cc:3037] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:21.207988 30981 raft_consensus.cc:2454] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72917baf5fd424da68b540baf17b13b in term 1.
I20260620 15:00:21.208003 31115 raft_consensus.cc:2454] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72917baf5fd424da68b540baf17b13b in term 1.
I20260620 15:00:21.208204 31182 leader_election.cc:302] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf42890bd0fc4e49aa2c88e3ed7c08a4, e72917baf5fd424da68b540baf17b13b; no voters:
I20260620 15:00:21.208354 31318 raft_consensus.cc:2781] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:21.208581 31318 raft_consensus.cc:686] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 1 LEADER]: Becoming Leader. State: Replica: e72917baf5fd424da68b540baf17b13b, State: Running, Role: LEADER
I20260620 15:00:21.208717 31318 consensus_queue.cc:237] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } }
I20260620 15:00:21.210054 30836 catalog_manager.cc:5495] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b reported cstate change: term changed from 0 to 1, leader changed from <none> to e72917baf5fd424da68b540baf17b13b (127.12.116.131). New cstate: current_term: 1 leader_uuid: "e72917baf5fd424da68b540baf17b13b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72917baf5fd424da68b540baf17b13b" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 38635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260620 15:00:21.226686 31311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.223078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52320 (local address 127.12.116.131:38635)
0620 15:00:21.223202 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.223204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.223214 (+ 10us) server_negotiation.cc:407] Connection header received
0620 15:00:21.223253 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.223254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.223305 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.223375 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:21.223538 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.224030 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.225026 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.225249 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.225419 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.225756 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:21.225870 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:21.225984 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.226506 (+ 522us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.226528 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260620 15:00:21.229048 30981 raft_consensus.cc:1261] T f4750b8fdbc24304b2147780edf6eadc P bf42890bd0fc4e49aa2c88e3ed7c08a4 [term 1 FOLLOWER]: Refusing update from remote peer e72917baf5fd424da68b540baf17b13b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:21.229198 31115 raft_consensus.cc:1261] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 1 FOLLOWER]: Refusing update from remote peer e72917baf5fd424da68b540baf17b13b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:21.229635 31322 consensus_queue.cc:1035] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf42890bd0fc4e49aa2c88e3ed7c08a4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:21.229825 31318 consensus_queue.cc:1035] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11646ec06b34bd4917bd638be9614f4" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:21.233479 31325 mvcc.cc:205] Tried to move back new op lower bound from 7298939376550670336 to 7298939376471793664. Current Snapshot: MvccSnapshot[applied={T|T < 7298939376550670336}]
I20260620 15:00:21.234681 31326 mvcc.cc:205] Tried to move back new op lower bound from 7298939376550670336 to 7298939376471793664. Current Snapshot: MvccSnapshot[applied={T|T < 7298939376550670336 or (T in {7298939376550670336})}]
I20260620 15:00:21.236743 30836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:21.236904 30836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:21.237895 30836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 494088d5d7d449098d1a42e92a1030b5: Sending DeleteTablet for 3 replicas of tablet f4750b8fdbc24304b2147780edf6eadc
I20260620 15:00:21.238339 31095 tablet_service.cc:1514] Processing DeleteTablet for tablet f4750b8fdbc24304b2147780edf6eadc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:21 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:41944
I20260620 15:00:21.238338 31226 tablet_service.cc:1514] Processing DeleteTablet for tablet f4750b8fdbc24304b2147780edf6eadc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:21 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:52306
I20260620 15:00:21.238479 30961 tablet_service.cc:1514] Processing DeleteTablet for tablet f4750b8fdbc24304b2147780edf6eadc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:21 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:54156
I20260620 15:00:21.238579 31335 tablet_replica.cc:330] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: stopping tablet replica
I20260620 15:00:21.238692 31335 raft_consensus.cc:2229] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:21.238816 31335 raft_consensus.cc:2258] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:21.238896 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30898
I20260620 15:00:21.239337 31335 ts_tablet_manager.cc:1905] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:21.241616 31335 ts_tablet_manager.cc:1918] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:21.241707 31335 log.cc:1196] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/f4750b8fdbc24304b2147780edf6eadc
I20260620 15:00:21.241966 31335 ts_tablet_manager.cc:1939] T f4750b8fdbc24304b2147780edf6eadc P e11646ec06b34bd4917bd638be9614f4: Deleting consensus metadata
I20260620 15:00:21.242650 30820 catalog_manager.cc:4841] TS e11646ec06b34bd4917bd638be9614f4 (127.12.116.130:43541): tablet f4750b8fdbc24304b2147780edf6eadc (table test-table [id=011ce9fe2c5a4aa3b42648bdcf832aa6]) successfully deleted
I20260620 15:00:21.243604 31336 tablet_replica.cc:330] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: stopping tablet replica
I20260620 15:00:21.243746 31336 raft_consensus.cc:2229] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 1 LEADER]: Raft consensus shutting down.
I20260620 15:00:21.243887 31336 raft_consensus.cc:2258] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:21.244393 31336 ts_tablet_manager.cc:1905] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:21.246622 31336 ts_tablet_manager.cc:1918] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:21.246738 31336 log.cc:1196] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/f4750b8fdbc24304b2147780edf6eadc
I20260620 15:00:21.247174 31336 ts_tablet_manager.cc:1939] T f4750b8fdbc24304b2147780edf6eadc P e72917baf5fd424da68b540baf17b13b: Deleting consensus metadata
I20260620 15:00:21.247833 30823 catalog_manager.cc:4841] TS e72917baf5fd424da68b540baf17b13b (127.12.116.131:38635): tablet f4750b8fdbc24304b2147780edf6eadc (table test-table [id=011ce9fe2c5a4aa3b42648bdcf832aa6]) successfully deleted
W20260620 15:00:21.248521 30820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:37481 (error 108)
I20260620 15:00:21.248627 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31032
I20260620 15:00:21.250036 31309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.249851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:37481 (local address 127.0.0.1:54170)
0620 15:00:21.249931 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.249985 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:37481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260620 15:00:21.250212 30820 catalog_manager.cc:4584] TS bf42890bd0fc4e49aa2c88e3ed7c08a4 (127.12.116.129:37481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f4750b8fdbc24304b2147780edf6eadc: Network error: Client connection negotiation failed: client connection to 127.12.116.129:37481: connect: Connection refused (error 111)
I20260620 15:00:21.255847 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31166
I20260620 15:00:21.262705 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 30804
2026-06-20T15:00:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2580 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-06-20T15:00:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:21Z Disabled control of system clock
I20260620 15:00:21.296283 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:33177
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:45973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:33177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:21.401634 31342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:21.401919 31342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:21.401943 31342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:21.403321 31342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:21.403376 31342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:21.403390 31342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:21.403403 31342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:21.403416 31342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:21.405102 31342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:33177
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:33177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:21.405388 31342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:21.405687 31342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:21.411954 31347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:21.412127 31348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:21.411954 31350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:21.412631 31342 server_base.cc:1034] running on GCE node
I20260620 15:00:21.412954 31342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:21.413319 31342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:21.414768 31342 hybrid_clock.cc:648] HybridClock initialized: now 1781967621414511 us; error 58 us; skew 500 ppm
I20260620 15:00:21.416786 31342 webserver.cc:460] Webserver started at http://127.12.116.190:34817/ using document root <none> and password file <none>
I20260620 15:00:21.417104 31342 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:21.417160 31342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:21.417308 31342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:21.418577 31342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "fac3c6ee25784fc0b0568937f8802b48"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "eef457166413d458a16d8173d48d9a8d"
server_key_iv: "729e56a10ba1e5cc19ebfa259108b8ce"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.419004 31342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "fac3c6ee25784fc0b0568937f8802b48"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "eef457166413d458a16d8173d48d9a8d"
server_key_iv: "729e56a10ba1e5cc19ebfa259108b8ce"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.420842 31342 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:21.422224 31356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.422876 31342 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:21.423281 31342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "fac3c6ee25784fc0b0568937f8802b48"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "eef457166413d458a16d8173d48d9a8d"
server_key_iv: "729e56a10ba1e5cc19ebfa259108b8ce"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.424698 31342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:21.456859 31342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:21.457275 31342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:21.457657 31342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:21.462605 31342 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:33177
I20260620 15:00:21.462868 31408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:33177 every 8 connection(s)
I20260620 15:00:21.463189 31342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:21.464272 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31342
I20260620 15:00:21.464488 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:21.464594 31409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:21.464772 12754 external_mini_cluster.cc:1428] Setting key c4de7d3c4e39fe728b47ab59fea7b0a7
I20260620 15:00:21.469384 31409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: Bootstrap starting.
I20260620 15:00:21.470453 31409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:21.470813 31409 log.cc:824] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:21.472203 31409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: No bootstrap required, opened a new log
I20260620 15:00:21.475425 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.465707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50154 (local address 127.12.116.190:33177)
0620 15:00:21.466161 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.466172 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.466207 (+ 35us) server_negotiation.cc:407] Connection header received
0620 15:00:21.466801 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.466812 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.466911 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.467107 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:21.467367 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.469058 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.470370 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.471069 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.471203 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.473961 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:21.473968 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:21.473968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:21.474381 (+ 413us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:21.474442 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:21.474460 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:21.474672 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.475037 (+ 365us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.475156 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":119,"threads_started":1}
I20260620 15:00:21.476177 31409 raft_consensus.cc:348] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac3c6ee25784fc0b0568937f8802b48" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33177 } }
I20260620 15:00:21.476382 31409 raft_consensus.cc:374] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:21.476451 31409 raft_consensus.cc:729] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac3c6ee25784fc0b0568937f8802b48, State: Initialized, Role: FOLLOWER
I20260620 15:00:21.476594 31409 consensus_queue.cc:260] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac3c6ee25784fc0b0568937f8802b48" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33177 } }
I20260620 15:00:21.476691 31409 raft_consensus.cc:388] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:21.476724 31409 raft_consensus.cc:482] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:21.476794 31409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:21.477492 31409 raft_consensus.cc:504] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac3c6ee25784fc0b0568937f8802b48" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33177 } }
I20260620 15:00:21.477607 31409 leader_election.cc:302] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fac3c6ee25784fc0b0568937f8802b48; no voters:
I20260620 15:00:21.477861 31409 leader_election.cc:288] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:21.477898 31414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:21.478006 31414 raft_consensus.cc:686] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [term 1 LEADER]: Becoming Leader. State: Replica: fac3c6ee25784fc0b0568937f8802b48, State: Running, Role: LEADER
I20260620 15:00:21.478101 31414 consensus_queue.cc:237] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac3c6ee25784fc0b0568937f8802b48" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33177 } }
I20260620 15:00:21.478262 31409 sys_catalog.cc:564] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:21.478480 31416 sys_catalog.cc:455] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fac3c6ee25784fc0b0568937f8802b48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac3c6ee25784fc0b0568937f8802b48" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33177 } } }
I20260620 15:00:21.478480 31415 sys_catalog.cc:455] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fac3c6ee25784fc0b0568937f8802b48. Latest consensus state: current_term: 1 leader_uuid: "fac3c6ee25784fc0b0568937f8802b48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac3c6ee25784fc0b0568937f8802b48" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 33177 } } }
I20260620 15:00:21.478649 31415 sys_catalog.cc:458] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:21.478802 31416 sys_catalog.cc:458] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48 [sys.catalog]: This master's current role is: LEADER
W20260620 15:00:21.480472 31430 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:21.480608 31430 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:21.480777 31418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:21.481154 31418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:21.482872 31418 catalog_manager.cc:1347] Generated new cluster ID: 8fed03bed0d745269d0848596bd31a51
I20260620 15:00:21.482936 31418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:21.495915 31418 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:21.496697 31418 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:21.498778 31418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: Generated new TSK 0
I20260620 15:00:21.498996 31418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:21.506486 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33177
--builtin_ntp_servers=127.12.116.148:45973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:21.637769 31433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:21.638052 31433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:21.638092 31433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:21.639536 31433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:21.639626 31433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:21.639673 31433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 15:00:21.641485 31433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:21.641812 31433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:21.642160 31433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:21.649277 31439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:21.649401 31441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:21.649806 31433 server_base.cc:1034] running on GCE node
W20260620 15:00:21.649304 31438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:21.650177 31433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:21.650542 31433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:21.651754 31433 hybrid_clock.cc:648] HybridClock initialized: now 1781967621651736 us; error 31 us; skew 500 ppm
I20260620 15:00:21.653610 31433 webserver.cc:460] Webserver started at http://127.12.116.129:37777/ using document root <none> and password file <none>
I20260620 15:00:21.653949 31433 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:21.654035 31433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:21.654410 31433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:21.656441 31433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "32e9030a67ff4e9eafc79eaa574d5497"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "5397ba8599cde21c451bbe5685642a97"
server_key_iv: "7f94fffe3633706debb7342531c39396"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.656924 31433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "32e9030a67ff4e9eafc79eaa574d5497"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "5397ba8599cde21c451bbe5685642a97"
server_key_iv: "7f94fffe3633706debb7342531c39396"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.658783 31433 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260620 15:00:21.659969 31447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.660209 31433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:21.660365 31433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "32e9030a67ff4e9eafc79eaa574d5497"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "5397ba8599cde21c451bbe5685642a97"
server_key_iv: "7f94fffe3633706debb7342531c39396"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.660606 31433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:21.702620 31433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:21.703069 31433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:21.703210 31433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:21.703512 31433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:21.704596 31433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:21.704671 31433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.704708 31433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:21.704728 31433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.713213 31433 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:43321
I20260620 15:00:21.713323 31560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:43321 every 8 connection(s)
I20260620 15:00:21.713688 31433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 15:00:21.717433 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31433
I20260620 15:00:21.717593 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 15:00:21.717814 12754 external_mini_cluster.cc:1428] Setting key 79bd90afb3e7c8366f31947caf4e00bd
I20260620 15:00:21.719440 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33177
--builtin_ntp_servers=127.12.116.148:45973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 15:00:21.721551 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.714546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:49017 (local address 127.12.116.190:33177)
0620 15:00:21.714595 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.714597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.714952 (+ 355us) server_negotiation.cc:407] Connection header received
0620 15:00:21.715423 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.715425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.715443 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.715518 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:21.716470 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.717224 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.719019 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.719257 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.719339 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.721097 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:21.721100 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:21.721100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:21.721114 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:21.721138 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:21.721144 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:21.721241 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.721380 (+ 139us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.721422 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 15:00:21.721747 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.714502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:33177 (local address 127.12.116.129:49017)
0620 15:00:21.714717 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.714761 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.715292 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.715702 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.715706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.715717 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:21.716277 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.716282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.717362 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.717363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.718830 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.718835 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.719374 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.719375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.719565 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.720711 (+ 1146us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:21.720711 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:21.720763 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:21.720801 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:21.721265 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:21.721273 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:21.721277 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.721359 (+ 82us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.721473 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260620 15:00:21.722498 31561 heartbeater.cc:347] Connected to a master server at 127.12.116.190:33177
I20260620 15:00:21.722620 31561 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:21.722880 31561 heartbeater.cc:511] Master 127.12.116.190:33177 requested a full tablet report, sending...
I20260620 15:00:21.723588 31373 ts_manager.cc:194] Registered new tserver with Master: 32e9030a67ff4e9eafc79eaa574d5497 (127.12.116.129:43321)
I20260620 15:00:21.724741 31373 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.129:49017
W20260620 15:00:21.824528 31564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:21.824788 31564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:21.824816 31564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:21.826256 31564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:21.826313 31564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:21.826342 31564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:21.828029 31564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:21.828547 31564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:21.828922 31564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:21.835695 31570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:21.835688 31572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:21.835688 31569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:21.837073 31564 server_base.cc:1034] running on GCE node
I20260620 15:00:21.837312 31564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:21.837584 31564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:21.841228 31564 hybrid_clock.cc:648] HybridClock initialized: now 1781967621840986 us; error 126 us; skew 500 ppm
I20260620 15:00:21.843940 31564 webserver.cc:460] Webserver started at http://127.12.116.130:38025/ using document root <none> and password file <none>
I20260620 15:00:21.844205 31564 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:21.844249 31564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:21.844421 31564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:21.846035 31564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "16277bc9d91e448d9c0f04e2ee39cd3b"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "ca3a9397d6bd01e950593fd715d654bc"
server_key_iv: "da0220dc8ba15b66d08e6041e2e05c4c"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.846648 31564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "16277bc9d91e448d9c0f04e2ee39cd3b"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "ca3a9397d6bd01e950593fd715d654bc"
server_key_iv: "da0220dc8ba15b66d08e6041e2e05c4c"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.848903 31564 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 15:00:21.850164 31578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.850600 31564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:21.850867 31564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "16277bc9d91e448d9c0f04e2ee39cd3b"
format_stamp: "Formatted at 2026-06-20 15:00:21 on dist-test-slave-7v06"
server_key: "ca3a9397d6bd01e950593fd715d654bc"
server_key_iv: "da0220dc8ba15b66d08e6041e2e05c4c"
server_key_version: "encryptionkey@0"
I20260620 15:00:21.850999 31564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:21.867323 31564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:21.867690 31564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:21.867852 31564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:21.868494 31564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:21.869038 31564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:21.869206 31564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.869515 31564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:21.869580 31564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:21.876855 31564 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:39095
I20260620 15:00:21.876901 31691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:39095 every 8 connection(s)
I20260620 15:00:21.877389 31564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:21.885385 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.878334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:51819 (local address 127.12.116.190:33177)
0620 15:00:21.878395 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:21.878398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:21.878716 (+ 318us) server_negotiation.cc:407] Connection header received
0620 15:00:21.879795 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:21.879797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:21.879813 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:21.879898 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:21.881254 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.882107 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.883539 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.883761 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.883846 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.885051 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:21.885053 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:21.885053 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:21.885059 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:21.885074 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:21.885079 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:21.885142 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:21.885259 (+ 117us) server_negotiation.cc:299] Negotiation successful
0620 15:00:21.885295 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 15:00:21.885692 31694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:21.878316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:33177 (local address 127.12.116.130:51819)
0620 15:00:21.878525 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:21.878620 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:21.879560 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:21.880101 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:21.880108 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:21.880120 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:21.881025 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.881035 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.882232 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.882234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.883412 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:21.883417 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:21.883859 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:21.883860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:21.884036 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:21.884803 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:21.884804 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:21.884837 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:21.884864 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:21.885161 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:21.885167 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:21.885171 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:21.885263 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 15:00:21.885391 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260620 15:00:21.886456 31692 heartbeater.cc:347] Connected to a master server at 127.12.116.190:33177
I20260620 15:00:21.886574 31692 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:21.886771 31692 heartbeater.cc:511] Master 127.12.116.190:33177 requested a full tablet report, sending...
I20260620 15:00:21.887353 31373 ts_manager.cc:194] Registered new tserver with Master: 16277bc9d91e448d9c0f04e2ee39cd3b (127.12.116.130:39095)
I20260620 15:00:21.887854 31373 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.130:51819
I20260620 15:00:21.887893 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31564
I20260620 15:00:21.888062 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 15:00:21.888355 12754 external_mini_cluster.cc:1428] Setting key e010b9bdfc972bc37a7315fd3ffc7e96
I20260620 15:00:21.890002 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33177
--builtin_ntp_servers=127.12.116.148:45973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:22.001816 31695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:22.002105 31695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:22.002133 31695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:22.003573 31695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:22.003635 31695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:22.003669 31695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:22.006134 31695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:33177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:22.006879 31695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:22.007375 31695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:22.016552 31701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:22.016623 31695 server_base.cc:1034] running on GCE node
W20260620 15:00:22.016754 31700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:22.016776 31703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:22.017434 31695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:22.017797 31695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:22.019035 31695 hybrid_clock.cc:648] HybridClock initialized: now 1781967622019022 us; error 33 us; skew 500 ppm
I20260620 15:00:22.021000 31695 webserver.cc:460] Webserver started at http://127.12.116.131:45971/ using document root <none> and password file <none>
I20260620 15:00:22.021313 31695 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:22.021392 31695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:22.021566 31695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:22.022785 31695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "023b468c99b444a6a175725f0d671cc6"
format_stamp: "Formatted at 2026-06-20 15:00:22 on dist-test-slave-7v06"
server_key: "6510e5c7a9c1959aefd8fb691b594d42"
server_key_iv: "a3e8017f2db2f72ae8affd3c15578ba1"
server_key_version: "encryptionkey@0"
I20260620 15:00:22.023216 31695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "023b468c99b444a6a175725f0d671cc6"
format_stamp: "Formatted at 2026-06-20 15:00:22 on dist-test-slave-7v06"
server_key: "6510e5c7a9c1959aefd8fb691b594d42"
server_key_iv: "a3e8017f2db2f72ae8affd3c15578ba1"
server_key_version: "encryptionkey@0"
I20260620 15:00:22.025035 31695 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260620 15:00:22.026803 31709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:22.027880 31695 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260620 15:00:22.028302 31695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "023b468c99b444a6a175725f0d671cc6"
format_stamp: "Formatted at 2026-06-20 15:00:22 on dist-test-slave-7v06"
server_key: "6510e5c7a9c1959aefd8fb691b594d42"
server_key_iv: "a3e8017f2db2f72ae8affd3c15578ba1"
server_key_version: "encryptionkey@0"
I20260620 15:00:22.028519 31695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:22.043340 31695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:22.043823 31695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:22.044027 31695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:22.044292 31695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:22.044703 31695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:22.044767 31695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:22.044806 31695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:22.044834 31695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:22.051476 31695 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:44143
I20260620 15:00:22.051530 31822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:44143 every 8 connection(s)
I20260620 15:00:22.051905 31695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:22.057801 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31695
I20260620 15:00:22.058058 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 15:00:22.058771 12754 external_mini_cluster.cc:1428] Setting key 4f3acfed83ebbfb0c5f2d14331736768
I20260620 15:00:22.060334 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.052726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:37669 (local address 127.12.116.190:33177)
0620 15:00:22.052899 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.052902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.053080 (+ 178us) server_negotiation.cc:407] Connection header received
0620 15:00:22.053681 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.053684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.053698 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.053774 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:22.055260 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.055785 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.057123 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.057435 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.057534 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.059606 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:22.059616 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:22.059618 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:22.059633 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:22.059675 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:22.059759 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:22.059854 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.060161 (+ 307us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.060204 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260620 15:00:22.060634 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.052705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:33177 (local address 127.12.116.131:37669)
0620 15:00:22.052937 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.052983 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:22.053525 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:22.054035 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:22.054042 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:22.054104 (+ 62us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:22.054993 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.055012 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.055921 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.055922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.056966 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.056970 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.057608 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.057610 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.057823 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.059255 (+ 1432us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:22.059270 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:22.059328 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:22.059370 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:22.059857 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:22.060023 (+ 166us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:22.060027 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:22.060139 (+ 112us) client_negotiation.cc:240] Negotiation successful
0620 15:00:22.060320 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":122,"threads_started":1}
I20260620 15:00:22.061144 31823 heartbeater.cc:347] Connected to a master server at 127.12.116.190:33177
I20260620 15:00:22.061269 31823 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:22.061486 31823 heartbeater.cc:511] Master 127.12.116.190:33177 requested a full tablet report, sending...
I20260620 15:00:22.062297 31373 ts_manager.cc:194] Registered new tserver with Master: 023b468c99b444a6a175725f0d671cc6 (127.12.116.131:44143)
I20260620 15:00:22.063001 31373 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.131:37669
I20260620 15:00:22.073601 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 15:00:22.081910 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.076270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50156 (local address 127.12.116.190:33177)
0620 15:00:22.076444 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.076446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.076459 (+ 13us) server_negotiation.cc:407] Connection header received
0620 15:00:22.076596 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.076597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.076608 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.076818 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:22.077231 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.078019 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.079626 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.079881 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.079988 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.081247 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:22.081249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:22.081250 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:22.081257 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:22.081282 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:22.081288 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:22.081420 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.081678 (+ 258us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.081700 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260620 15:00:22.085479 31373 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 15:00:22.087827 31373 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 15:00:22.098294 31836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.092505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:44143 (local address 127.0.0.1:50004)
0620 15:00:22.093427 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.093440 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:22.093496 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:22.093701 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:22.093701 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:22.093704 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:22.093787 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.093788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.094720 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.094723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.096481 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.096485 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.097762 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.097764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.097980 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.098016 (+ 36us) client_negotiation.cc:769] Sending connection context
0620 15:00:22.098108 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 15:00:22.098179 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":40,"thread_start_us":150,"threads_started":1}
I20260620 15:00:22.098609 31837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.092754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50004 (local address 127.12.116.131:44143)
0620 15:00:22.093029 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.093036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.093518 (+ 482us) server_negotiation.cc:407] Connection header received
0620 15:00:22.093571 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.093573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.093591 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.093687 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:22.093853 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.094598 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.096649 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.097462 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.097635 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.097753 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.098454 (+ 701us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.098524 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":100,"threads_started":1}
I20260620 15:00:22.098663 31839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.092786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46050 (local address 127.12.116.130:39095)
0620 15:00:22.093060 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.093064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.093356 (+ 292us) server_negotiation.cc:407] Connection header received
0620 15:00:22.093409 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.093412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.093429 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.093521 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:22.093808 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.095024 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.096898 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.097647 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.097716 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.097984 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.098359 (+ 375us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.098569 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":94,"threads_started":1}
I20260620 15:00:22.098304 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.092505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:39095 (local address 127.0.0.1:46050)
0620 15:00:22.093288 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.093298 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:22.093346 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:22.093605 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:22.093605 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:22.093607 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:22.093733 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.093735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.095138 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.095139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.096726 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.096736 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.097925 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.097927 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.097986 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.098016 (+ 30us) client_negotiation.cc:769] Sending connection context
0620 15:00:22.098205 (+ 189us) client_negotiation.cc:240] Negotiation successful
0620 15:00:22.098247 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"mutex_wait_us":72,"thread_start_us":139,"threads_started":1}
I20260620 15:00:22.099381 31757 tablet_service.cc:1467] Processing CreateTablet for tablet e638ca19486747e0adc95df4f6f5ca65 (DEFAULT_TABLE table=test-table [id=1a0dfb60c0154805a1d56e9144ce5b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:22.099828 31757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e638ca19486747e0adc95df4f6f5ca65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:22.099990 31834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.092504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43321 (local address 127.0.0.1:54880)
0620 15:00:22.092973 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.093053 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:22.093138 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:22.093472 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:22.093495 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:22.093499 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:22.093654 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.093659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.095138 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.095139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.096727 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.096736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.099524 (+ 2788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.099527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.099719 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.099726 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 15:00:22.099809 (+ 83us) client_negotiation.cc:240] Negotiation successful
0620 15:00:22.099872 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":161,"thread_start_us":83,"threads_started":1}
I20260620 15:00:22.099895 31626 tablet_service.cc:1467] Processing CreateTablet for tablet e638ca19486747e0adc95df4f6f5ca65 (DEFAULT_TABLE table=test-table [id=1a0dfb60c0154805a1d56e9144ce5b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:22.100294 31838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.092783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54880 (local address 127.12.116.129:43321)
0620 15:00:22.093145 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.093149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.093163 (+ 14us) server_negotiation.cc:407] Connection header received
0620 15:00:22.093248 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.093250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.093269 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.093379 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:22.093753 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.095020 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.098228 (+ 3208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.099274 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.099363 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.099475 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.099849 (+ 374us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.100010 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":78,"threads_started":1}
I20260620 15:00:22.101279 31495 tablet_service.cc:1467] Processing CreateTablet for tablet e638ca19486747e0adc95df4f6f5ca65 (DEFAULT_TABLE table=test-table [id=1a0dfb60c0154805a1d56e9144ce5b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:22.101919 31495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e638ca19486747e0adc95df4f6f5ca65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:22.104912 31626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e638ca19486747e0adc95df4f6f5ca65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:22.105958 31840 tablet_bootstrap.cc:492] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Bootstrap starting.
I20260620 15:00:22.106769 31840 tablet_bootstrap.cc:654] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:22.107143 31840 log.cc:824] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:22.108031 31840 tablet_bootstrap.cc:492] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: No bootstrap required, opened a new log
I20260620 15:00:22.108142 31840 ts_tablet_manager.cc:1397] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260620 15:00:22.108976 31842 tablet_bootstrap.cc:492] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Bootstrap starting.
I20260620 15:00:22.109704 31842 tablet_bootstrap.cc:654] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:22.110052 31842 log.cc:824] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:22.110466 31843 tablet_bootstrap.cc:492] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: Bootstrap starting.
I20260620 15:00:22.111114 31842 tablet_bootstrap.cc:492] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: No bootstrap required, opened a new log
I20260620 15:00:22.111238 31843 tablet_bootstrap.cc:654] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:22.111263 31842 ts_tablet_manager.cc:1397] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:22.111488 31840 raft_consensus.cc:348] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.111601 31843 log.cc:824] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:22.111681 31840 raft_consensus.cc:374] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:22.111729 31840 raft_consensus.cc:729] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023b468c99b444a6a175725f0d671cc6, State: Initialized, Role: FOLLOWER
I20260620 15:00:22.111893 31840 consensus_queue.cc:260] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.112210 31840 ts_tablet_manager.cc:1428] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260620 15:00:22.112386 31823 heartbeater.cc:503] Master 127.12.116.190:33177 was elected leader, sending a full tablet report...
I20260620 15:00:22.112603 31843 tablet_bootstrap.cc:492] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: No bootstrap required, opened a new log
I20260620 15:00:22.112672 31843 ts_tablet_manager.cc:1397] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 15:00:22.114660 31842 raft_consensus.cc:348] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.114820 31842 raft_consensus.cc:374] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:22.114845 31842 raft_consensus.cc:729] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16277bc9d91e448d9c0f04e2ee39cd3b, State: Initialized, Role: FOLLOWER
I20260620 15:00:22.115260 31843 raft_consensus.cc:348] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.115391 31843 raft_consensus.cc:374] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:22.115412 31843 raft_consensus.cc:729] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32e9030a67ff4e9eafc79eaa574d5497, State: Initialized, Role: FOLLOWER
I20260620 15:00:22.114948 31842 consensus_queue.cc:260] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.115545 31843 consensus_queue.cc:260] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.115990 31843 ts_tablet_manager.cc:1428] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260620 15:00:22.116523 31842 ts_tablet_manager.cc:1428] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260620 15:00:22.116631 31692 heartbeater.cc:503] Master 127.12.116.190:33177 was elected leader, sending a full tablet report...
I20260620 15:00:22.117765 31561 heartbeater.cc:503] Master 127.12.116.190:33177 was elected leader, sending a full tablet report...
W20260620 15:00:22.128221 31693 tablet.cc:2369] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:22.187973 31848 raft_consensus.cc:482] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:22.188198 31848 raft_consensus.cc:504] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.188665 31848 leader_election.cc:288] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32e9030a67ff4e9eafc79eaa574d5497 (127.12.116.129:43321), 023b468c99b444a6a175725f0d671cc6 (127.12.116.131:44143)
I20260620 15:00:22.194026 31838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.189072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:52307 (local address 127.12.116.129:43321)
0620 15:00:22.189156 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.189158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.189350 (+ 192us) server_negotiation.cc:407] Connection header received
0620 15:00:22.189395 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.189395 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.189406 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.189454 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:22.189799 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.190601 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.192564 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.193280 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.193378 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.193388 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.193890 (+ 502us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.193945 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260620 15:00:22.194010 31694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.188947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:44143 (local address 127.12.116.130:40623)
0620 15:00:22.189033 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.189047 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:22.189121 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:22.189305 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:22.189306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:22.189308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:22.189394 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.189396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.190756 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.190757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.192115 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.192121 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.193618 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.193620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.193727 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.193733 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 15:00:22.193817 (+ 84us) client_negotiation.cc:240] Negotiation successful
0620 15:00:22.193902 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":77}
I20260620 15:00:22.194027 31837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.189070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:40623 (local address 127.12.116.131:44143)
0620 15:00:22.189141 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.189143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.189156 (+ 13us) server_negotiation.cc:407] Connection header received
0620 15:00:22.189195 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.189196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.189207 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.189275 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:22.189637 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.190601 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.192563 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.193280 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.193378 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.193388 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.193890 (+ 502us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.193945 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 15:00:22.194013 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.188958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43321 (local address 127.12.116.130:52307)
0620 15:00:22.189234 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.189252 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:22.189329 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:22.189556 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:22.189557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:22.189560 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:22.189650 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.189652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.190755 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.190757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.192115 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:22.192121 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.193622 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.193622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:22.193742 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.193745 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 15:00:22.193817 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 15:00:22.193895 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":142,"thread_start_us":150,"threads_started":1}
I20260620 15:00:22.194597 31777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e638ca19486747e0adc95df4f6f5ca65" candidate_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023b468c99b444a6a175725f0d671cc6" is_pre_election: true
I20260620 15:00:22.194821 31777 raft_consensus.cc:2454] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16277bc9d91e448d9c0f04e2ee39cd3b in term 0.
I20260620 15:00:22.195071 31515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e638ca19486747e0adc95df4f6f5ca65" candidate_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32e9030a67ff4e9eafc79eaa574d5497" is_pre_election: true
I20260620 15:00:22.195219 31515 raft_consensus.cc:2454] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16277bc9d91e448d9c0f04e2ee39cd3b in term 0.
I20260620 15:00:22.195672 31580 leader_election.cc:302] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023b468c99b444a6a175725f0d671cc6, 16277bc9d91e448d9c0f04e2ee39cd3b; no voters:
I20260620 15:00:22.195875 31848 raft_consensus.cc:2781] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 15:00:22.195986 31848 raft_consensus.cc:482] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 15:00:22.196029 31848 raft_consensus.cc:3037] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:22.196861 31848 raft_consensus.cc:504] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.197057 31848 leader_election.cc:288] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [CANDIDATE]: Term 1 election: Requested vote from peers 32e9030a67ff4e9eafc79eaa574d5497 (127.12.116.129:43321), 023b468c99b444a6a175725f0d671cc6 (127.12.116.131:44143)
I20260620 15:00:22.197327 31515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e638ca19486747e0adc95df4f6f5ca65" candidate_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32e9030a67ff4e9eafc79eaa574d5497"
I20260620 15:00:22.197355 31777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e638ca19486747e0adc95df4f6f5ca65" candidate_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023b468c99b444a6a175725f0d671cc6"
I20260620 15:00:22.197458 31777 raft_consensus.cc:3037] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:22.197438 31515 raft_consensus.cc:3037] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:22.198279 31777 raft_consensus.cc:2454] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16277bc9d91e448d9c0f04e2ee39cd3b in term 1.
I20260620 15:00:22.198287 31515 raft_consensus.cc:2454] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16277bc9d91e448d9c0f04e2ee39cd3b in term 1.
I20260620 15:00:22.198663 31579 leader_election.cc:302] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16277bc9d91e448d9c0f04e2ee39cd3b, 32e9030a67ff4e9eafc79eaa574d5497; no voters:
I20260620 15:00:22.198815 31848 raft_consensus.cc:2781] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:22.199041 31848 raft_consensus.cc:686] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 1 LEADER]: Becoming Leader. State: Replica: 16277bc9d91e448d9c0f04e2ee39cd3b, State: Running, Role: LEADER
I20260620 15:00:22.199141 31848 consensus_queue.cc:237] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } }
I20260620 15:00:22.200378 31372 catalog_manager.cc:5495] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 16277bc9d91e448d9c0f04e2ee39cd3b (127.12.116.130). New cstate: current_term: 1 leader_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16277bc9d91e448d9c0f04e2ee39cd3b" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 } health_report { overall_health: UNKNOWN } } }
W20260620 15:00:22.214625 31562 tablet.cc:2369] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:22.230036 31839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.226323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46060 (local address 127.12.116.130:39095)
0620 15:00:22.226396 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:22.226397 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:22.226523 (+ 126us) server_negotiation.cc:407] Connection header received
0620 15:00:22.226572 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:22.226573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:22.226604 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:22.226796 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:22.227015 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.227552 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.228796 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:22.229009 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:22.229076 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:22.229336 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:22.229434 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:22.229520 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:22.229846 (+ 326us) server_negotiation.cc:299] Negotiation successful
0620 15:00:22.229908 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 15:00:22.233052 31777 raft_consensus.cc:1261] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 1 FOLLOWER]: Refusing update from remote peer 16277bc9d91e448d9c0f04e2ee39cd3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:22.233346 31515 raft_consensus.cc:1261] T e638ca19486747e0adc95df4f6f5ca65 P 32e9030a67ff4e9eafc79eaa574d5497 [term 1 FOLLOWER]: Refusing update from remote peer 16277bc9d91e448d9c0f04e2ee39cd3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:22.233784 31848 consensus_queue.cc:1035] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32e9030a67ff4e9eafc79eaa574d5497" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 43321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:22.233968 31850 consensus_queue.cc:1035] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "023b468c99b444a6a175725f0d671cc6" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 44143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:22.240701 31371 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:22.240851 31371 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:22.242106 31371 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fac3c6ee25784fc0b0568937f8802b48: Sending DeleteTablet for 3 replicas of tablet e638ca19486747e0adc95df4f6f5ca65
I20260620 15:00:22.242604 31495 tablet_service.cc:1514] Processing DeleteTablet for tablet e638ca19486747e0adc95df4f6f5ca65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:22 UTC) from {username='slave'} at 127.0.0.1:54880
I20260620 15:00:22.242612 31626 tablet_service.cc:1514] Processing DeleteTablet for tablet e638ca19486747e0adc95df4f6f5ca65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:22 UTC) from {username='slave'} at 127.0.0.1:46050
I20260620 15:00:22.242991 31757 tablet_service.cc:1514] Processing DeleteTablet for tablet e638ca19486747e0adc95df4f6f5ca65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:22 UTC) from {username='slave'} at 127.0.0.1:50004
I20260620 15:00:22.243269 31863 tablet_replica.cc:330] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: stopping tablet replica
I20260620 15:00:22.243399 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31433
I20260620 15:00:22.243433 31863 raft_consensus.cc:2229] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 1 LEADER]: Raft consensus shutting down.
I20260620 15:00:22.243599 31863 raft_consensus.cc:2258] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:22.245862 31863 ts_tablet_manager.cc:1905] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:22.248641 31863 ts_tablet_manager.cc:1918] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:22.248765 31863 log.cc:1196] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/e638ca19486747e0adc95df4f6f5ca65
I20260620 15:00:22.249064 31863 ts_tablet_manager.cc:1939] T e638ca19486747e0adc95df4f6f5ca65 P 16277bc9d91e448d9c0f04e2ee39cd3b: Deleting consensus metadata
I20260620 15:00:22.250203 31359 catalog_manager.cc:4841] TS 16277bc9d91e448d9c0f04e2ee39cd3b (127.12.116.130:39095): tablet e638ca19486747e0adc95df4f6f5ca65 (table test-table [id=1a0dfb60c0154805a1d56e9144ce5b08]) successfully deleted
W20260620 15:00:22.250396 31357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:43321 (error 108)
I20260620 15:00:22.251034 31865 tablet_replica.cc:330] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: stopping tablet replica
I20260620 15:00:22.251104 31834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:22.250900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:43321 (local address 127.0.0.1:54886)
0620 15:00:22.250978 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:22.251056 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:43321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260620 15:00:22.251206 31865 raft_consensus.cc:2229] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 15:00:22.251297 31357 catalog_manager.cc:4584] TS 32e9030a67ff4e9eafc79eaa574d5497 (127.12.116.129:43321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e638ca19486747e0adc95df4f6f5ca65: Network error: Client connection negotiation failed: client connection to 127.12.116.129:43321: connect: Connection refused (error 111)
I20260620 15:00:22.251354 31865 raft_consensus.cc:2258] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:22.251948 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31564
I20260620 15:00:22.254161 31865 ts_tablet_manager.cc:1905] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:22.257334 31865 ts_tablet_manager.cc:1918] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:22.257519 31865 log.cc:1196] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/e638ca19486747e0adc95df4f6f5ca65
I20260620 15:00:22.257804 31865 ts_tablet_manager.cc:1939] T e638ca19486747e0adc95df4f6f5ca65 P 023b468c99b444a6a175725f0d671cc6: Deleting consensus metadata
I20260620 15:00:22.260210 31358 catalog_manager.cc:4841] TS 023b468c99b444a6a175725f0d671cc6 (127.12.116.131:44143): tablet e638ca19486747e0adc95df4f6f5ca65 (table test-table [id=1a0dfb60c0154805a1d56e9144ce5b08]) successfully deleted
I20260620 15:00:22.261116 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31695
I20260620 15:00:22.268850 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31342
2026-06-20T15:00:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1003 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:22 dist-test-slave-7v06 krb5kdc[31869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:22 dist-test-slave-7v06 krb5kdc[31869](info): set up 2 sockets
Jun 20 15:00:22 dist-test-slave-7v06 krb5kdc[31869](info): commencing operation
krb5kdc: starting...
W20260620 15:00:23.425232 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:23 dist-test-slave-7v06 krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:23.587522 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:41347
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:41347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:23.708267 31882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:23.708585 31882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:23.708616 31882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:23.710403 31882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:23.710476 31882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:23.710492 31882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:23.710507 31882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:23.710521 31882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:23.712527 31882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:41347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:41347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:23.712854 31882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:23.713169 31882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:23.726234 31890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:23.726257 31887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:23.726584 31888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:23.726769 31882 server_base.cc:1034] running on GCE node
I20260620 15:00:23.727113 31882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:23.727478 31882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:23.728715 31882 hybrid_clock.cc:648] HybridClock initialized: now 1781967623728673 us; error 63 us; skew 500 ppm
Jun 20 15:00:23 dist-test-slave-7v06 krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967623, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:23.732815 31882 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:23.733390 31882 webserver.cc:460] Webserver started at http://127.12.116.190:38589/ using document root <none> and password file <none>
I20260620 15:00:23.733688 31882 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:23.733769 31882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:23.733935 31882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:23.735241 31882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa"
format_stamp: "Formatted at 2026-06-20 15:00:23 on dist-test-slave-7v06"
server_key: "5e21288ed44d65512196f97344a52e05"
server_key_iv: "377625626d7cadc3bdcc9184f094fb59"
server_key_version: "encryptionkey@0"
I20260620 15:00:23.736490 31882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa"
format_stamp: "Formatted at 2026-06-20 15:00:23 on dist-test-slave-7v06"
server_key: "5e21288ed44d65512196f97344a52e05"
server_key_iv: "377625626d7cadc3bdcc9184f094fb59"
server_key_version: "encryptionkey@0"
I20260620 15:00:23.740231 31882 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260620 15:00:23.742625 31897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:23.743263 31882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260620 15:00:23.743422 31882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa"
format_stamp: "Formatted at 2026-06-20 15:00:23 on dist-test-slave-7v06"
server_key: "5e21288ed44d65512196f97344a52e05"
server_key_iv: "377625626d7cadc3bdcc9184f094fb59"
server_key_version: "encryptionkey@0"
I20260620 15:00:23.743548 31882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:23.768555 31882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:23.771734 31882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:23.771983 31882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:23.777088 31882 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:41347
I20260620 15:00:23.777088 31949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:41347 every 8 connection(s)
I20260620 15:00:23.777925 31882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:23.779037 31950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:23.781733 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa: Bootstrap starting.
I20260620 15:00:23.782441 31950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:23.782752 31950 log.cc:824] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:23.783612 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa: No bootstrap required, opened a new log
I20260620 15:00:23.785540 31950 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41347 } }
I20260620 15:00:23.785728 31950 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:23.785756 31950 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8d5cd58ee64fc6a500f5ac9b093cfa, State: Initialized, Role: FOLLOWER
I20260620 15:00:23.785920 31950 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41347 } }
I20260620 15:00:23.786003 31950 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:23.786068 31950 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:23.786147 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31882
I20260620 15:00:23.786166 31950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:23.786302 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:23.786679 12754 external_mini_cluster.cc:1428] Setting key 740b02a4fe674f7b0bbcd3596e8f042f
I20260620 15:00:23.786959 31950 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41347 } }
I20260620 15:00:23.787092 31950 leader_election.cc:302] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe8d5cd58ee64fc6a500f5ac9b093cfa; no voters:
I20260620 15:00:23.787315 31950 leader_election.cc:288] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:23.787348 31954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:23.787479 31954 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [term 1 LEADER]: Becoming Leader. State: Replica: fe8d5cd58ee64fc6a500f5ac9b093cfa, State: Running, Role: LEADER
I20260620 15:00:23.787580 31954 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41347 } }
I20260620 15:00:23.787631 31950 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:23.787926 31954 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41347 } } }
I20260620 15:00:23.788017 31954 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:23.788161 31954 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe8d5cd58ee64fc6a500f5ac9b093cfa. Latest consensus state: current_term: 1 leader_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8d5cd58ee64fc6a500f5ac9b093cfa" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 41347 } } }
I20260620 15:00:23.788220 31954 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:23.788800 31959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:23.789436 31959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:23.793123 31959 catalog_manager.cc:1347] Generated new cluster ID: 4a7aabcd8d44405c84c8277f81fb524b
I20260620 15:00:23.793201 31959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 15:00:23 dist-test-slave-7v06 krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:23.800768 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:23.787217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.12.116.190:41347)
0620 15:00:23.787434 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:23.787447 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:23.787490 (+ 43us) server_negotiation.cc:407] Connection header received
0620 15:00:23.787647 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:23.787656 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:23.787723 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:23.787886 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:23.789032 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:23.790501 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:23.791688 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:23.792519 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:23.792698 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:23.795703 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:23.795821 (+ 118us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:23.795822 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:23.795853 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:23.798948 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:23.799405 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:23.799411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:23.799416 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:23.799529 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:23.799750 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:23.799751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:23.799752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:23.800060 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:23.800260 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:23.800359 (+ 99us) server_negotiation.cc:299] Negotiation successful
0620 15:00:23.800530 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
I20260620 15:00:23.826439 31959 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:23.827263 31959 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:23.833257 31959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa: Generated new TSK 0
I20260620 15:00:23.833519 31959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.116.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
Entry for principal kudu/127.12.116.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab.
I20260620 15:00:23.890429 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41347
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:23.993034 31976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:23.993281 31976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:23.993311 31976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:23.994638 31976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:23.994709 31976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:23.994742 31976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 15:00:23.996794 31976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.129.keytab
--principal=kudu/127.12.116.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:23.997109 31976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:23.997408 31976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:24.005838 31982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.005843 31984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.006234 31981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:24.007320 31976 server_base.cc:1034] running on GCE node
I20260620 15:00:24.007650 31976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:24.007987 31976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:24.009203 31976 hybrid_clock.cc:648] HybridClock initialized: now 1781967624009171 us; error 49 us; skew 500 ppm
Jun 20 15:00:24 dist-test-slave-7v06 krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967624, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:24.012620 31976 init.cc:377] Logged in from keytab as kudu/127.12.116.129@KRBTEST.COM (short username kudu)
I20260620 15:00:24.013192 31976 webserver.cc:460] Webserver started at http://127.12.116.129:34331/ using document root <none> and password file <none>
I20260620 15:00:24.013443 31976 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:24.013516 31976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:24.013684 31976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:24.014863 31976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "b0ea987d580f4b5aa495154b0a5b93e4"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "198985a2f03ecfdd321b1eca2412e8bb"
server_key_iv: "cf17aadacbc575c5bb4e59afc6c08866"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.015275 31976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "b0ea987d580f4b5aa495154b0a5b93e4"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "198985a2f03ecfdd321b1eca2412e8bb"
server_key_iv: "cf17aadacbc575c5bb4e59afc6c08866"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.018347 31976 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260620 15:00:24.019879 31991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.020558 31976 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:24.020712 31976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "b0ea987d580f4b5aa495154b0a5b93e4"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "198985a2f03ecfdd321b1eca2412e8bb"
server_key_iv: "cf17aadacbc575c5bb4e59afc6c08866"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.020830 31976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:24.039688 31976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:24.043442 31976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:24.043665 31976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:24.043972 31976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:24.044446 31976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:24.044512 31976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.044559 31976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:24.044605 31976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.051141 31976 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:40613
I20260620 15:00:24.051193 32104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:40613 every 8 connection(s)
I20260620 15:00:24.051591 31976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 15:00:24.059152 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 31976
I20260620 15:00:24.059635 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
Jun 20 15:00:24 dist-test-slave-7v06 krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967624, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.129@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:24.060139 12754 external_mini_cluster.cc:1428] Setting key 33a3af88da14e5f7183134e00e38c291
I20260620 15:00:24.065366 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.052569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:57745 (local address 127.12.116.190:41347)
0620 15:00:24.052638 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.052641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.052860 (+ 219us) server_negotiation.cc:407] Connection header received
0620 15:00:24.053419 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.053420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.053435 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.053507 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:24.054792 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.055401 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.056672 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.056885 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.056947 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.061511 (+ 4564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:24.061513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:24.061513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:24.061524 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:24.063299 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.063939 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.063941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.063942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.064017 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.064465 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.064467 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.064468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.064652 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:24.064763 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.065078 (+ 315us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.065198 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 15:00:24.065395 32107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.052516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41347 (local address 127.12.116.129:57745)
0620 15:00:24.052717 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.052764 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.053284 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.053638 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.053642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.054443 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:24.054668 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.054673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.055559 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.055560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.056583 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.056586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.056995 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.056997 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.057117 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.057882 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:24.057892 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:24.061301 (+ 3409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:24.063483 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:24.063502 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:24.063506 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:24.063845 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:24.064100 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:24.064101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:24.064101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:24.064275 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:24.064762 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:24.064768 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:24.064917 (+ 149us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.065012 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.065195 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260620 15:00:24.065996 32105 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41347
I20260620 15:00:24.066120 32105 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:24.066375 32105 heartbeater.cc:511] Master 127.12.116.190:41347 requested a full tablet report, sending...
I20260620 15:00:24.067013 31914 ts_manager.cc:194] Registered new tserver with Master: b0ea987d580f4b5aa495154b0a5b93e4 (127.12.116.129:40613)
I20260620 15:00:24.068071 31914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.129@KRBTEST.COM'} at 127.12.116.129:57745
WARNING: no policy specified for kudu/127.12.116.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
Entry for principal kudu/127.12.116.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab.
I20260620 15:00:24.097765 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41347
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:24.207875 32110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:24.208173 32110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:24.208206 32110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:24.209767 32110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:24.209841 32110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:24.209877 32110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:24.211798 32110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.130.keytab
--principal=kudu/127.12.116.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:24.212147 32110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:24.212536 32110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:24.220418 32115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.220752 32116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.220752 32118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:24.221725 32110 server_base.cc:1034] running on GCE node
I20260620 15:00:24.221975 32110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:24.222270 32110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:24.225106 32110 hybrid_clock.cc:648] HybridClock initialized: now 1781967624225063 us; error 70 us; skew 500 ppm
Jun 20 15:00:24 dist-test-slave-7v06 krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967624, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:24.228756 32110 init.cc:377] Logged in from keytab as kudu/127.12.116.130@KRBTEST.COM (short username kudu)
I20260620 15:00:24.229314 32110 webserver.cc:460] Webserver started at http://127.12.116.130:33307/ using document root <none> and password file <none>
I20260620 15:00:24.229593 32110 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:24.229679 32110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:24.229846 32110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:24.231077 32110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "5cf2c314d993424891185b20b1d45b39"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "b1a75e636956ac74190a9eb2965372fd"
server_key_iv: "2a0027ae1c883204a5cefba45e42b041"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.231510 32110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "5cf2c314d993424891185b20b1d45b39"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "b1a75e636956ac74190a9eb2965372fd"
server_key_iv: "2a0027ae1c883204a5cefba45e42b041"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.233253 32110 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:24.234314 32125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.234606 32110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:24.234827 32110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "5cf2c314d993424891185b20b1d45b39"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "b1a75e636956ac74190a9eb2965372fd"
server_key_iv: "2a0027ae1c883204a5cefba45e42b041"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.234923 32110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:24.272629 32110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:24.275213 32110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:24.276177 32110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:24.280105 32110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:24.281153 32110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:24.281771 32110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260620 15:00:24.281883 32110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:24.281945 32110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.291352 32110 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:43105
I20260620 15:00:24.291445 32238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:43105 every 8 connection(s)
I20260620 15:00:24.291857 32110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:24.299672 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 32110
I20260620 15:00:24.299813 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 15:00:24.300014 12754 external_mini_cluster.cc:1428] Setting key 9b8d7449437c865e3320b498bc7958d7
Jun 20 15:00:24 dist-test-slave-7v06 krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967624, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.130@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:24.307214 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.292803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:58081 (local address 127.12.116.190:41347)
0620 15:00:24.292874 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.292876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.293096 (+ 220us) server_negotiation.cc:407] Connection header received
0620 15:00:24.293788 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.293789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.293801 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.293863 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:24.295417 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.295950 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.297564 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.297802 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.297874 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.302045 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:24.302047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:24.302048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:24.302059 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:24.304689 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.305785 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.305787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.305788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.305859 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.306280 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.306281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.306281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.306438 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:24.306508 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.307010 (+ 502us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.307136 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 15:00:24.307531 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.292771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41347 (local address 127.12.116.130:58081)
0620 15:00:24.292947 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.292995 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.293641 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.294012 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.294016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.294722 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:24.295185 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.295192 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.296527 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.296528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.297432 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.297436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.297952 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.297953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.298096 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.298781 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:24.298791 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:24.301894 (+ 3103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:24.304855 (+ 2961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:24.305153 (+ 298us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:24.305159 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:24.305630 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:24.305958 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:24.305959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:24.305960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:24.306169 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:24.306525 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:24.306534 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:24.306748 (+ 214us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.306900 (+ 152us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.307203 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260620 15:00:24.308295 32239 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41347
I20260620 15:00:24.308450 32239 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:24.308692 32239 heartbeater.cc:511] Master 127.12.116.190:41347 requested a full tablet report, sending...
I20260620 15:00:24.309329 31914 ts_manager.cc:194] Registered new tserver with Master: 5cf2c314d993424891185b20b1d45b39 (127.12.116.130:43105)
I20260620 15:00:24.310031 31914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.130@KRBTEST.COM'} at 127.12.116.130:58081
WARNING: no policy specified for kudu/127.12.116.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
Entry for principal kudu/127.12.116.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab.
I20260620 15:00:24.336536 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41347
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:24.441491 32244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:24.441777 32244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:24.441807 32244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:24.443948 32244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:24.444437 32244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:24.444559 32244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:24.448222 32244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.131.keytab
--principal=kudu/127.12.116.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:41347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:24.448799 32244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:24.449110 32244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 15:00:24.455294 32244 server_base.cc:1034] running on GCE node
W20260620 15:00:24.455224 32250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.455224 32249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.455221 32252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:24.455916 32244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:24.456254 32244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:24.457485 32244 hybrid_clock.cc:648] HybridClock initialized: now 1781967624457396 us; error 103 us; skew 500 ppm
Jun 20 15:00:24 dist-test-slave-7v06 krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967624, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:24.461473 32244 init.cc:377] Logged in from keytab as kudu/127.12.116.131@KRBTEST.COM (short username kudu)
I20260620 15:00:24.462747 32244 webserver.cc:460] Webserver started at http://127.12.116.131:42665/ using document root <none> and password file <none>
I20260620 15:00:24.463164 32244 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:24.463238 32244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:24.463397 32244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:24.465648 32244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "834e83f86ca544f7b5c18ec1f6840773"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "412f091a674ddfb01cf344d55960b689"
server_key_iv: "d38991be1ca1bee95a7c7a3cd31c3866"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.466207 32244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "834e83f86ca544f7b5c18ec1f6840773"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "412f091a674ddfb01cf344d55960b689"
server_key_iv: "d38991be1ca1bee95a7c7a3cd31c3866"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.468914 32244 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 15:00:24.470451 32259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.470954 32244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:24.471115 32244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "834e83f86ca544f7b5c18ec1f6840773"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "412f091a674ddfb01cf344d55960b689"
server_key_iv: "d38991be1ca1bee95a7c7a3cd31c3866"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.471287 32244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:24.486232 32244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:24.489243 32244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:24.489382 32244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:24.489650 32244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:24.490010 32244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:24.490046 32244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.490072 32244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:24.490085 32244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.497225 32244 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:36547
I20260620 15:00:24.497552 32372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:36547 every 8 connection(s)
I20260620 15:00:24.498020 32244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:24.505895 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 32244
I20260620 15:00:24.506022 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 15:00:24.506305 12754 external_mini_cluster.cc:1428] Setting key 6b0523304d67f59a36d96eff734a9ca3
Jun 20 15:00:24 dist-test-slave-7v06 krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967624, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.131@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:24.512894 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.499262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:39679 (local address 127.12.116.190:41347)
0620 15:00:24.499410 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.499414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.499785 (+ 371us) server_negotiation.cc:407] Connection header received
0620 15:00:24.500515 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.500517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.500534 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.500583 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:24.501755 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.502283 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.504295 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.505260 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.505545 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.509154 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:24.509156 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:24.509157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:24.509167 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:24.511028 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.511587 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.511588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.511589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.511662 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.511945 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.511946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.511946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.512100 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:24.512250 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.512673 (+ 423us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.512786 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260620 15:00:24.513156 32375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.499107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:41347 (local address 127.12.116.131:39679)
0620 15:00:24.499507 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.499575 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.500362 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.500684 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.500688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.501336 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:24.501582 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.501588 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.502419 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.502421 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.503775 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.503784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.505673 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.505680 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.505922 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.506826 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:24.506836 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:24.509003 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:24.511179 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:24.511194 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:24.511198 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:24.511489 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:24.511736 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:24.511737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:24.511738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:24.511866 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:24.512250 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:24.512259 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:24.512506 (+ 247us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.512646 (+ 140us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.512857 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":134,"threads_started":1}
I20260620 15:00:24.514106 32373 heartbeater.cc:347] Connected to a master server at 127.12.116.190:41347
I20260620 15:00:24.514348 32373 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:24.514703 32373 heartbeater.cc:511] Master 127.12.116.190:41347 requested a full tablet report, sending...
I20260620 15:00:24.515482 31914 ts_manager.cc:194] Registered new tserver with Master: 834e83f86ca544f7b5c18ec1f6840773 (127.12.116.131:36547)
I20260620 15:00:24.516036 31914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.116.131@KRBTEST.COM'} at 127.12.116.131:39679
I20260620 15:00:24.519848 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 15:00:24.531934 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.522188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50558 (local address 127.12.116.190:41347)
0620 15:00:24.522265 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.522267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.522327 (+ 60us) server_negotiation.cc:407] Connection header received
0620 15:00:24.522389 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.522390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.522400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.522462 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:24.523436 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.524237 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.525607 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.525819 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.525943 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.527663 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:24.527664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:24.527665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:24.527673 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:24.529323 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.530064 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.530067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.530067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.530405 (+ 338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:24.530977 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:24.530979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:24.530979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:24.531247 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:24.531401 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.531725 (+ 324us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.531852 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 15:00:24.534845 31914 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50558:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 15:00:24.539404 31914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 15:00:24.549698 32384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.543539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:43105 (local address 127.0.0.1:49276)
0620 15:00:24.543682 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.543727 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.543802 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.544734 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.544739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.544743 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:24.544945 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.544948 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.546558 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.546562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.548020 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.548024 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.549368 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.549370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.549443 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.549448 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.549484 (+ 36us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.549564 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260620 15:00:24.549811 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.544385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37160 (local address 127.12.116.129:40613)
0620 15:00:24.544729 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.544733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.544744 (+ 11us) server_negotiation.cc:407] Connection header received
0620 15:00:24.544794 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.544796 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.544812 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.544896 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:24.545203 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.546810 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.548490 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.549098 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.549229 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.549300 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.549645 (+ 345us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.549708 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":70,"threads_started":1}
I20260620 15:00:24.549971 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.543806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40613 (local address 127.0.0.1:37160)
0620 15:00:24.544463 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.544479 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.544574 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.544987 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.544988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.544990 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:24.545107 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.545110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.546965 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.546967 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.548364 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.548368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.549229 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.549230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.549332 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.549349 (+ 17us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.549433 (+ 84us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.549516 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":134,"thread_start_us":343,"threads_started":1}
I20260620 15:00:24.550228 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.543745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49276 (local address 127.12.116.130:43105)
0620 15:00:24.544454 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.544463 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.544480 (+ 17us) server_negotiation.cc:407] Connection header received
0620 15:00:24.544552 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.544558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.544582 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.545041 (+ 459us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:24.545136 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.546165 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.548161 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.549152 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.549862 (+ 710us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.550007 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.550066 (+ 59us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.550131 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":468,"threads_started":1}
I20260620 15:00:24.550346 32385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.543735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:36547 (local address 127.0.0.1:34014)
0620 15:00:24.544282 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.544538 (+ 256us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.544619 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.545045 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.545046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.545049 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:24.545123 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.545124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.546967 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.546969 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.548364 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.548368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.549558 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.549559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.549626 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.549630 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.549683 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.549726 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":20,"thread_start_us":640,"threads_started":1}
I20260620 15:00:24.550597 32389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.544583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34014 (local address 127.12.116.131:36547)
0620 15:00:24.544842 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.544847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.544859 (+ 12us) server_negotiation.cc:407] Connection header received
0620 15:00:24.544913 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.544915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.544932 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.545399 (+ 467us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:24.545556 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.546788 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.548452 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.549256 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.549372 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.549432 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.550451 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.550516 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":106,"threads_started":1}
I20260620 15:00:24.550860 32039 tablet_service.cc:1467] Processing CreateTablet for tablet 3e10bd88808d453692f505c3fc12cd39 (DEFAULT_TABLE table=test-table [id=15f4dc746bf743a1b02f491f7b6f939e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:24.551271 32039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e10bd88808d453692f505c3fc12cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:24.551281 32307 tablet_service.cc:1467] Processing CreateTablet for tablet 3e10bd88808d453692f505c3fc12cd39 (DEFAULT_TABLE table=test-table [id=15f4dc746bf743a1b02f491f7b6f939e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:24.551625 32307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e10bd88808d453692f505c3fc12cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:24.554713 32390 tablet_bootstrap.cc:492] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: Bootstrap starting.
I20260620 15:00:24.555195 32173 tablet_service.cc:1467] Processing CreateTablet for tablet 3e10bd88808d453692f505c3fc12cd39 (DEFAULT_TABLE table=test-table [id=15f4dc746bf743a1b02f491f7b6f939e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:24.555559 32173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e10bd88808d453692f505c3fc12cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:24.556103 32390 tablet_bootstrap.cc:654] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:24.557458 32390 log.cc:824] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:24.557968 32391 tablet_bootstrap.cc:492] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Bootstrap starting.
I20260620 15:00:24.558641 32391 tablet_bootstrap.cc:654] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:24.559137 32391 log.cc:824] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:24.559787 32390 tablet_bootstrap.cc:492] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: No bootstrap required, opened a new log
I20260620 15:00:24.559861 32390 ts_tablet_manager.cc:1397] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260620 15:00:24.560694 32394 tablet_bootstrap.cc:492] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Bootstrap starting.
I20260620 15:00:24.561879 32394 tablet_bootstrap.cc:654] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:24.562443 32394 log.cc:824] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:24.563344 32394 tablet_bootstrap.cc:492] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: No bootstrap required, opened a new log
I20260620 15:00:24.563460 32394 ts_tablet_manager.cc:1397] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 15:00:24.563083 32390 raft_consensus.cc:348] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.563617 32390 raft_consensus.cc:374] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:24.563720 32390 raft_consensus.cc:729] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0ea987d580f4b5aa495154b0a5b93e4, State: Initialized, Role: FOLLOWER
I20260620 15:00:24.564816 32390 consensus_queue.cc:260] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.565198 32391 tablet_bootstrap.cc:492] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: No bootstrap required, opened a new log
I20260620 15:00:24.565301 32391 ts_tablet_manager.cc:1397] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260620 15:00:24.565364 32390 ts_tablet_manager.cc:1428] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260620 15:00:24.565572 32105 heartbeater.cc:503] Master 127.12.116.190:41347 was elected leader, sending a full tablet report...
I20260620 15:00:24.566596 32394 raft_consensus.cc:348] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.566912 32394 raft_consensus.cc:374] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:24.566972 32394 raft_consensus.cc:729] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf2c314d993424891185b20b1d45b39, State: Initialized, Role: FOLLOWER
I20260620 15:00:24.567175 32394 consensus_queue.cc:260] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.567533 32394 ts_tablet_manager.cc:1428] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260620 15:00:24.567751 32239 heartbeater.cc:503] Master 127.12.116.190:41347 was elected leader, sending a full tablet report...
I20260620 15:00:24.567917 32391 raft_consensus.cc:348] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.568082 32391 raft_consensus.cc:374] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:24.568157 32391 raft_consensus.cc:729] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 834e83f86ca544f7b5c18ec1f6840773, State: Initialized, Role: FOLLOWER
I20260620 15:00:24.568331 32391 consensus_queue.cc:260] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.568756 32391 ts_tablet_manager.cc:1428] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260620 15:00:24.568917 32373 heartbeater.cc:503] Master 127.12.116.190:41347 was elected leader, sending a full tablet report...
I20260620 15:00:24.575587 32397 raft_consensus.cc:482] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:24.575732 32397 raft_consensus.cc:504] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.576221 32397 leader_election.cc:288] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0ea987d580f4b5aa495154b0a5b93e4 (127.12.116.129:40613), 834e83f86ca544f7b5c18ec1f6840773 (127.12.116.131:36547)
I20260620 15:00:24.579485 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.576602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:44093 (local address 127.12.116.129:40613)
0620 15:00:24.576753 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.576756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.576795 (+ 39us) server_negotiation.cc:407] Connection header received
0620 15:00:24.576873 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.576874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.576884 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.576927 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:24.577098 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.577574 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.578684 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.579079 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.579177 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.579189 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.579365 (+ 176us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.579409 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260620 15:00:24.579509 32399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.576500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40613 (local address 127.12.116.130:44093)
0620 15:00:24.576745 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.576756 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.576808 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.576938 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.576939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.576940 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:24.577023 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.577025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.577665 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.577666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.578559 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.578562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.579182 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.579183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.579275 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.579280 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.579347 (+ 67us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.579398 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":44,"thread_start_us":115,"threads_started":1}
I20260620 15:00:24.579517 32389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.576510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:36315 (local address 127.12.116.131:36547)
0620 15:00:24.576601 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.576603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.576615 (+ 12us) server_negotiation.cc:407] Connection header received
0620 15:00:24.576762 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.576763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.576773 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.576854 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:24.577024 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.577535 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.578701 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.579119 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.579213 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.579223 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.579402 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.579445 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260620 15:00:24.579566 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.576465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:36547 (local address 127.12.116.130:36315)
0620 15:00:24.576557 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.576570 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:24.576637 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:24.576858 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:24.576859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:24.576861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:24.576938 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.576940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.577646 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.577647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.578587 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:24.578590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.579222 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.579223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:24.579325 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.579328 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 15:00:24.579396 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 15:00:24.579445 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":4}
I20260620 15:00:24.580781 32059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e10bd88808d453692f505c3fc12cd39" candidate_uuid: "5cf2c314d993424891185b20b1d45b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" is_pre_election: true
I20260620 15:00:24.580778 32327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e10bd88808d453692f505c3fc12cd39" candidate_uuid: "5cf2c314d993424891185b20b1d45b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "834e83f86ca544f7b5c18ec1f6840773" is_pre_election: true
I20260620 15:00:24.581007 32059 raft_consensus.cc:2454] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf2c314d993424891185b20b1d45b39 in term 0.
I20260620 15:00:24.581007 32327 raft_consensus.cc:2454] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf2c314d993424891185b20b1d45b39 in term 0.
I20260620 15:00:24.584236 32127 leader_election.cc:302] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf2c314d993424891185b20b1d45b39, 834e83f86ca544f7b5c18ec1f6840773; no voters:
I20260620 15:00:24.584929 32397 raft_consensus.cc:2781] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 15:00:24.585155 32397 raft_consensus.cc:482] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 15:00:24.585227 32397 raft_consensus.cc:3037] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:24.587752 32397 raft_consensus.cc:504] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.588423 32397 leader_election.cc:288] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [CANDIDATE]: Term 1 election: Requested vote from peers b0ea987d580f4b5aa495154b0a5b93e4 (127.12.116.129:40613), 834e83f86ca544f7b5c18ec1f6840773 (127.12.116.131:36547)
I20260620 15:00:24.588574 32327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e10bd88808d453692f505c3fc12cd39" candidate_uuid: "5cf2c314d993424891185b20b1d45b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "834e83f86ca544f7b5c18ec1f6840773"
I20260620 15:00:24.588625 32059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e10bd88808d453692f505c3fc12cd39" candidate_uuid: "5cf2c314d993424891185b20b1d45b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0ea987d580f4b5aa495154b0a5b93e4"
I20260620 15:00:24.588737 32327 raft_consensus.cc:3037] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:24.588760 32059 raft_consensus.cc:3037] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:24.589775 32059 raft_consensus.cc:2454] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf2c314d993424891185b20b1d45b39 in term 1.
I20260620 15:00:24.589802 32327 raft_consensus.cc:2454] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf2c314d993424891185b20b1d45b39 in term 1.
I20260620 15:00:24.590061 32127 leader_election.cc:302] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf2c314d993424891185b20b1d45b39, 834e83f86ca544f7b5c18ec1f6840773; no voters:
I20260620 15:00:24.590261 32397 raft_consensus.cc:2781] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:24.590477 32397 raft_consensus.cc:686] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf2c314d993424891185b20b1d45b39, State: Running, Role: LEADER
I20260620 15:00:24.590596 32397 consensus_queue.cc:237] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } }
I20260620 15:00:24.591697 31913 catalog_manager.cc:5495] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf2c314d993424891185b20b1d45b39 (127.12.116.130). New cstate: current_term: 1 leader_uuid: "5cf2c314d993424891185b20b1d45b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cf2c314d993424891185b20b1d45b39" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 43105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 } health_report { overall_health: UNKNOWN } } }
I20260620 15:00:24.602305 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.599430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49278 (local address 127.12.116.130:43105)
0620 15:00:24.599531 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.599533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.599544 (+ 11us) server_negotiation.cc:407] Connection header received
0620 15:00:24.599585 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.599586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.599608 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.599751 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:24.599932 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.600546 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.601389 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.601625 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.601720 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.601906 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:24.602028 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:24.602132 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.602150 (+ 18us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.602174 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260620 15:00:24.604302 32059 raft_consensus.cc:1261] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 1 FOLLOWER]: Refusing update from remote peer 5cf2c314d993424891185b20b1d45b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:24.604380 32327 raft_consensus.cc:1261] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 1 FOLLOWER]: Refusing update from remote peer 5cf2c314d993424891185b20b1d45b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:24.604774 32400 consensus_queue.cc:1035] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ea987d580f4b5aa495154b0a5b93e4" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:24.604921 32397 consensus_queue.cc:1035] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "834e83f86ca544f7b5c18ec1f6840773" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 36547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:24.607357 32403 mvcc.cc:205] Tried to move back new op lower bound from 7298939390376148992 to 7298939390323912704. Current Snapshot: MvccSnapshot[applied={T|T < 7298939390376148992}]
I20260620 15:00:24.607740 32405 mvcc.cc:205] Tried to move back new op lower bound from 7298939390376148992 to 7298939390323912704. Current Snapshot: MvccSnapshot[applied={T|T < 7298939390376148992}]
I20260620 15:00:24.608158 32404 mvcc.cc:205] Tried to move back new op lower bound from 7298939390376148992 to 7298939390323912704. Current Snapshot: MvccSnapshot[applied={T|T < 7298939390376148992}]
I20260620 15:00:24.611228 31913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:24.611372 31913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:24.612427 31913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe8d5cd58ee64fc6a500f5ac9b093cfa: Sending DeleteTablet for 3 replicas of tablet 3e10bd88808d453692f505c3fc12cd39
I20260620 15:00:24.612815 32173 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e10bd88808d453692f505c3fc12cd39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:24 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:49276
I20260620 15:00:24.612921 32039 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e10bd88808d453692f505c3fc12cd39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:24 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:37160
I20260620 15:00:24.612999 32307 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e10bd88808d453692f505c3fc12cd39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:24 UTC) from {username='kudu', principal='kudu/127.12.116.190@KRBTEST.COM'} at 127.0.0.1:34014
I20260620 15:00:24.613057 32413 tablet_replica.cc:330] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: stopping tablet replica
I20260620 15:00:24.613153 32413 raft_consensus.cc:2229] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 1 LEADER]: Raft consensus shutting down.
I20260620 15:00:24.613216 32415 tablet_replica.cc:330] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: stopping tablet replica
I20260620 15:00:24.613289 32413 raft_consensus.cc:2258] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:24.613432 32414 tablet_replica.cc:330] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4: stopping tablet replica
I20260620 15:00:24.613628 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31976
I20260620 15:00:24.613569 32414 raft_consensus.cc:2229] T 3e10bd88808d453692f505c3fc12cd39 P b0ea987d580f4b5aa495154b0a5b93e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:24.614032 32413 ts_tablet_manager.cc:1905] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:24.615494 32415 raft_consensus.cc:2229] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:24.615648 32415 raft_consensus.cc:2258] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:24.616164 32415 ts_tablet_manager.cc:1905] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:24.616319 32413 ts_tablet_manager.cc:1918] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:24.616431 32413 log.cc:1196] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/3e10bd88808d453692f505c3fc12cd39
I20260620 15:00:24.617256 32413 ts_tablet_manager.cc:1939] T 3e10bd88808d453692f505c3fc12cd39 P 5cf2c314d993424891185b20b1d45b39: Deleting consensus metadata
I20260620 15:00:24.617861 31901 catalog_manager.cc:4841] TS 5cf2c314d993424891185b20b1d45b39 (127.12.116.130:43105): tablet 3e10bd88808d453692f505c3fc12cd39 (table test-table [id=15f4dc746bf743a1b02f491f7b6f939e]) successfully deleted
I20260620 15:00:24.618533 32415 ts_tablet_manager.cc:1918] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:24.618630 32415 log.cc:1196] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/3e10bd88808d453692f505c3fc12cd39
I20260620 15:00:24.618927 32415 ts_tablet_manager.cc:1939] T 3e10bd88808d453692f505c3fc12cd39 P 834e83f86ca544f7b5c18ec1f6840773: Deleting consensus metadata
I20260620 15:00:24.620450 31899 catalog_manager.cc:4841] TS 834e83f86ca544f7b5c18ec1f6840773 (127.12.116.131:36547): tablet 3e10bd88808d453692f505c3fc12cd39 (table test-table [id=15f4dc746bf743a1b02f491f7b6f939e]) successfully deleted
W20260620 15:00:24.621323 31901 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:40613 (error 108)
I20260620 15:00:24.622116 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.621977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:40613 (local address 127.0.0.1:37168)
0620 15:00:24.622043 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:24.622085 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260620 15:00:24.622107 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 32110
W20260620 15:00:24.622306 31901 catalog_manager.cc:4584] TS b0ea987d580f4b5aa495154b0a5b93e4 (127.12.116.129:40613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3e10bd88808d453692f505c3fc12cd39: Network error: Client connection negotiation failed: client connection to 127.12.116.129:40613: connect: Connection refused (error 111)
I20260620 15:00:24.631961 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 32244
I20260620 15:00:24.641798 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 31882
2026-06-20T15:00:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2377 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-06-20T15:00:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:24Z Disabled control of system clock
I20260620 15:00:24.678748 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36875
--webserver_interface=127.12.116.190
--webserver_port=0
--builtin_ntp_servers=127.12.116.148:45065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:24.780745 32420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:24.781097 32420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:24.781142 32420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:24.782557 32420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:24.782648 32420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:24.782670 32420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:24.782691 32420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:24.782721 32420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:24.784406 32420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36875
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:24.784741 32420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:24.785084 32420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:24.791354 32426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.791455 32425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:24.791379 32428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:24.791455 32420 server_base.cc:1034] running on GCE node
I20260620 15:00:24.792074 32420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:24.792515 32420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:24.793730 32420 hybrid_clock.cc:648] HybridClock initialized: now 1781967624793704 us; error 47 us; skew 500 ppm
I20260620 15:00:24.795390 32420 webserver.cc:460] Webserver started at http://127.12.116.190:44481/ using document root <none> and password file <none>
I20260620 15:00:24.795674 32420 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:24.795728 32420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:24.795843 32420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:24.797446 32420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "4839e5600b6c4b018050a4e5728454d2"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "bcfb25b9d7a0333b3ed417ee03c421b6"
server_key_iv: "fd0a61fccb8a4dcf5cfb00bc2c5a057a"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.797892 32420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "4839e5600b6c4b018050a4e5728454d2"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "bcfb25b9d7a0333b3ed417ee03c421b6"
server_key_iv: "fd0a61fccb8a4dcf5cfb00bc2c5a057a"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.799539 32420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 15:00:24.800521 32434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:24.800851 32420 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:24.800946 32420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "4839e5600b6c4b018050a4e5728454d2"
format_stamp: "Formatted at 2026-06-20 15:00:24 on dist-test-slave-7v06"
server_key: "bcfb25b9d7a0333b3ed417ee03c421b6"
server_key_iv: "fd0a61fccb8a4dcf5cfb00bc2c5a057a"
server_key_version: "encryptionkey@0"
I20260620 15:00:24.801047 32420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:24.820884 32420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:24.821308 32420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:24.821485 32420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:24.828065 32420 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:36875
I20260620 15:00:24.828250 32486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:36875 every 8 connection(s)
I20260620 15:00:24.828827 32420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:24.830389 32487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:24.833314 32487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2: Bootstrap starting.
I20260620 15:00:24.834046 32487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:24.834390 32487 log.cc:824] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:24.835563 32487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2: No bootstrap required, opened a new log
I20260620 15:00:24.836576 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 32420
I20260620 15:00:24.836741 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:24.836957 12754 external_mini_cluster.cc:1428] Setting key 96d10f93fd8a191114fe3dc429ee0b9c
I20260620 15:00:24.839860 32487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4839e5600b6c4b018050a4e5728454d2" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36875 } }
I20260620 15:00:24.840148 32487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:24.840197 32487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4839e5600b6c4b018050a4e5728454d2, State: Initialized, Role: FOLLOWER
I20260620 15:00:24.840391 32487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4839e5600b6c4b018050a4e5728454d2" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36875 } }
I20260620 15:00:24.840508 32487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:24.840562 32487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:24.840626 32487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:24.841643 32487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4839e5600b6c4b018050a4e5728454d2" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36875 } }
I20260620 15:00:24.841786 32487 leader_election.cc:302] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4839e5600b6c4b018050a4e5728454d2; no voters:
I20260620 15:00:24.841981 32487 leader_election.cc:288] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:24.842252 32492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:24.842293 32487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:24.842494 32492 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [term 1 LEADER]: Becoming Leader. State: Replica: 4839e5600b6c4b018050a4e5728454d2, State: Running, Role: LEADER
I20260620 15:00:24.842612 32492 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4839e5600b6c4b018050a4e5728454d2" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36875 } }
I20260620 15:00:24.843192 32494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4839e5600b6c4b018050a4e5728454d2. Latest consensus state: current_term: 1 leader_uuid: "4839e5600b6c4b018050a4e5728454d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4839e5600b6c4b018050a4e5728454d2" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36875 } } }
I20260620 15:00:24.843216 32493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4839e5600b6c4b018050a4e5728454d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4839e5600b6c4b018050a4e5728454d2" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36875 } } }
I20260620 15:00:24.843449 32493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:24.843677 32494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:24.844188 32501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:24.844823 32501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:24.847143 32501 catalog_manager.cc:1347] Generated new cluster ID: 1f8684feabd149ccb3baacc1eaed70f0
I20260620 15:00:24.847216 32501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:24.847612 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:24.837979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44978 (local address 127.12.116.190:36875)
0620 15:00:24.838521 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:24.838538 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:24.838587 (+ 49us) server_negotiation.cc:407] Connection header received
0620 15:00:24.839789 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:24.839800 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:24.839903 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:24.840142 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:24.840676 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.843379 (+ 2703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.844964 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:24.845484 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:24.845655 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:24.846544 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:24.846580 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:24.846581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:24.846845 (+ 264us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:24.846892 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:24.846911 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:24.846991 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:24.847276 (+ 285us) server_negotiation.cc:299] Negotiation successful
0620 15:00:24.847375 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":118,"threads_started":1}
I20260620 15:00:24.853504 32501 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:24.854300 32501 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:24.858675 32501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2: Generated new TSK 0
I20260620 15:00:24.858935 32501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:24.863821 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.129:0
--local_ip_for_outbound_sockets=127.12.116.129
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36875
--builtin_ntp_servers=127.12.116.148:45065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 15:00:24.986531 32511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:24.986879 32511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:24.986927 32511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:24.989614 32511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:24.989717 32511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:24.989777 32511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.129
I20260620 15:00:24.992964 32511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.116.129
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.129
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:24.993316 32511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:24.993734 32511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:25.000988 32517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:25.001390 32516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:25.001350 32519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:25.001942 32511 server_base.cc:1034] running on GCE node
I20260620 15:00:25.002324 32511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:25.002679 32511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:25.003898 32511 hybrid_clock.cc:648] HybridClock initialized: now 1781967625003876 us; error 42 us; skew 500 ppm
I20260620 15:00:25.005774 32511 webserver.cc:460] Webserver started at http://127.12.116.129:42431/ using document root <none> and password file <none>
I20260620 15:00:25.006059 32511 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:25.006109 32511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:25.006268 32511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:25.007455 32511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data/instance:
uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "4b48d7385e251e727a24dd4fa51e353d"
server_key_iv: "c7b726750f5683489cce6a57f0daedf7"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.007865 32511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance:
uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "4b48d7385e251e727a24dd4fa51e353d"
server_key_iv: "c7b726750f5683489cce6a57f0daedf7"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.009447 32511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 15:00:25.010393 32525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.010581 32511 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:25.010691 32511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal
uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "4b48d7385e251e727a24dd4fa51e353d"
server_key_iv: "c7b726750f5683489cce6a57f0daedf7"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.010790 32511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:25.023617 32511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:25.023999 32511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:25.024179 32511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:25.024551 32511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:25.024921 32511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:25.024978 32511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.025025 32511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:25.025066 32511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.031597 32511 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.129:45883
I20260620 15:00:25.031843 32638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.129:45883 every 8 connection(s)
I20260620 15:00:25.032121 32511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/data/info.pb
I20260620 15:00:25.039803 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.033469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.129:54945 (local address 127.12.116.190:36875)
0620 15:00:25.033562 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.033564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.033587 (+ 23us) server_negotiation.cc:407] Connection header received
0620 15:00:25.034301 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.034304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.034323 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.034399 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:25.035190 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.035931 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.037751 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.037979 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.038069 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.039368 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:25.039370 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:25.039370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:25.039377 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:25.039396 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:25.039401 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:25.039468 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.039680 (+ 212us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.039721 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260620 15:00:25.040618 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.033225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36875 (local address 127.12.116.129:54945)
0620 15:00:25.033456 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.033502 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.034116 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.034481 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.034484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.034494 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:25.035029 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.035034 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.036142 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.036144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.037536 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.037545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.038147 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.038149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.038368 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.039132 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:25.039133 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:25.039176 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:25.039215 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:25.039530 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:25.039543 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:25.039548 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.039640 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.040025 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":111,"threads_started":1}
I20260620 15:00:25.041723 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 32511
I20260620 15:00:25.041764 32639 heartbeater.cc:347] Connected to a master server at 127.12.116.190:36875
I20260620 15:00:25.041842 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-0/wal/instance
I20260620 15:00:25.041922 32639 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:25.042174 32639 heartbeater.cc:511] Master 127.12.116.190:36875 requested a full tablet report, sending...
I20260620 15:00:25.042111 12754 external_mini_cluster.cc:1428] Setting key 6162fd12740f3458500ef7658f341f17
I20260620 15:00:25.043057 32451 ts_manager.cc:194] Registered new tserver with Master: dedd7a3dd814416f8fa8c6d95b6f4abd (127.12.116.129:45883)
I20260620 15:00:25.043849 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.130:0
--local_ip_for_outbound_sockets=127.12.116.130
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36875
--builtin_ntp_servers=127.12.116.148:45065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 15:00:25.044139 32451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.129:54945
W20260620 15:00:25.151232 32642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:25.151614 32642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:25.151659 32642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:25.155627 32642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:25.155722 32642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:25.155779 32642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.130
I20260620 15:00:25.158571 32642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.116.130
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.130
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:25.158936 32642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:25.159403 32642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:25.166446 32648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:25.166446 32650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:25.166471 32647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:25.167702 32642 server_base.cc:1034] running on GCE node
I20260620 15:00:25.167991 32642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:25.168303 32642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:25.169562 32642 hybrid_clock.cc:648] HybridClock initialized: now 1781967625169507 us; error 74 us; skew 500 ppm
I20260620 15:00:25.171695 32642 webserver.cc:460] Webserver started at http://127.12.116.130:44007/ using document root <none> and password file <none>
I20260620 15:00:25.171999 32642 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:25.172084 32642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:25.172269 32642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:25.174091 32642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data/instance:
uuid: "8de03eccd85f446db9001cdb477f1c8a"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "9f509a36872a54f9cf4a4a4081402175"
server_key_iv: "028a9bdce6ffb939ecb488256c86158d"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.175006 32642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance:
uuid: "8de03eccd85f446db9001cdb477f1c8a"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "9f509a36872a54f9cf4a4a4081402175"
server_key_iv: "028a9bdce6ffb939ecb488256c86158d"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.177312 32642 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.002s
I20260620 15:00:25.179352 32656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.180305 32642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260620 15:00:25.181874 32642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal
uuid: "8de03eccd85f446db9001cdb477f1c8a"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "9f509a36872a54f9cf4a4a4081402175"
server_key_iv: "028a9bdce6ffb939ecb488256c86158d"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.182566 32642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:25.197425 32642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:25.197811 32642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:25.197980 32642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:25.198263 32642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:25.198638 32642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:25.198700 32642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.198742 32642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:25.198771 32642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.207581 32642 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.130:39227
I20260620 15:00:25.207716 301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.130:39227 every 8 connection(s)
I20260620 15:00:25.208107 32642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/data/info.pb
I20260620 15:00:25.211843 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 32642
I20260620 15:00:25.211977 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal/instance
I20260620 15:00:25.212182 12754 external_mini_cluster.cc:1428] Setting key b57ab01cad007ed3e560606aab6a0b5f
I20260620 15:00:25.213369 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.116.131:0
--local_ip_for_outbound_sockets=127.12.116.131
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36875
--builtin_ntp_servers=127.12.116.148:45065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 15:00:25.219264 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.208983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:40043 (local address 127.12.116.190:36875)
0620 15:00:25.209056 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.209059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.209330 (+ 271us) server_negotiation.cc:407] Connection header received
0620 15:00:25.209884 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.209885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.209896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.209967 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:25.210679 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.211234 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.212729 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.213027 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.213098 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.218789 (+ 5691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:25.218792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:25.218793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:25.218801 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:25.218827 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:25.218835 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:25.218917 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.219064 (+ 147us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.219115 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 15:00:25.219535 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.208985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36875 (local address 127.12.116.130:40043)
0620 15:00:25.209200 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.209239 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.209759 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.210025 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.210029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.210037 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:25.210568 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.210572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.211361 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.211362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.212646 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.212650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.213137 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.213138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.213362 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.218543 (+ 5181us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:25.218544 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:25.218589 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:25.218627 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:25.218962 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:25.218969 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:25.218972 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.219042 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.219160 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260620 15:00:25.220191 302 heartbeater.cc:347] Connected to a master server at 127.12.116.190:36875
I20260620 15:00:25.220297 302 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:25.220526 302 heartbeater.cc:511] Master 127.12.116.190:36875 requested a full tablet report, sending...
I20260620 15:00:25.221069 32451 ts_manager.cc:194] Registered new tserver with Master: 8de03eccd85f446db9001cdb477f1c8a (127.12.116.130:39227)
I20260620 15:00:25.221624 32451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.130:40043
W20260620 15:00:25.322888 305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:25.324043 305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:25.324106 305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:25.327011 305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:25.327224 305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:25.327303 305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.116.131
I20260620 15:00:25.329612 305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:45065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.116.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.116.131
--webserver_port=0
--tserver_master_addrs=127.12.116.190:36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.116.131
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:25.330032 305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:25.330435 305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:25.336824 313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:25.336824 311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:25.336864 310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:25.338115 305 server_base.cc:1034] running on GCE node
I20260620 15:00:25.338438 305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:25.338798 305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:25.340073 305 hybrid_clock.cc:648] HybridClock initialized: now 1781967625340031 us; error 88 us; skew 500 ppm
I20260620 15:00:25.342345 305 webserver.cc:460] Webserver started at http://127.12.116.131:35421/ using document root <none> and password file <none>
I20260620 15:00:25.342665 305 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:25.342752 305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:25.342926 305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:25.344588 305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data/instance:
uuid: "852e1ceb45c54f938eb2881e7fafdbde"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "b40588c99bbb19f613d68ee3fba2f264"
server_key_iv: "360ea5965206c769de78665ee734cec4"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.344946 305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance:
uuid: "852e1ceb45c54f938eb2881e7fafdbde"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "b40588c99bbb19f613d68ee3fba2f264"
server_key_iv: "360ea5965206c769de78665ee734cec4"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.346458 305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260620 15:00:25.347678 319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.348234 305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:25.348407 305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal
uuid: "852e1ceb45c54f938eb2881e7fafdbde"
format_stamp: "Formatted at 2026-06-20 15:00:25 on dist-test-slave-7v06"
server_key: "b40588c99bbb19f613d68ee3fba2f264"
server_key_iv: "360ea5965206c769de78665ee734cec4"
server_key_version: "encryptionkey@0"
I20260620 15:00:25.348537 305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:25.366864 305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:25.367614 305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:25.367817 305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:25.368098 305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 15:00:25.369375 305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 15:00:25.369577 305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.370138 305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 15:00:25.370226 305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:25.380631 305 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.131:45663
I20260620 15:00:25.380707 432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.131:45663 every 8 connection(s)
I20260620 15:00:25.381201 305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/data/info.pb
I20260620 15:00:25.389531 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.382214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.131:56375 (local address 127.12.116.190:36875)
0620 15:00:25.382346 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.382348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.382571 (+ 223us) server_negotiation.cc:407] Connection header received
0620 15:00:25.383170 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.383171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.383184 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.383259 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:25.384084 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.384868 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.386729 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.386978 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.387077 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.388666 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:25.388669 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:25.388670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:25.388679 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:25.388703 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:25.388710 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:25.388937 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.389174 (+ 237us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.389272 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260620 15:00:25.389972 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.382122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:36875 (local address 127.12.116.131:56375)
0620 15:00:25.382338 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.382387 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.382945 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.383321 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.383325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.383335 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:25.383883 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.383888 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.385090 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.385092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.386500 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.386508 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.387090 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.387091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.387307 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.388394 (+ 1087us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 15:00:25.388395 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:25.388460 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 15:00:25.388504 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:25.388940 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:25.388951 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:25.388956 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.389178 (+ 222us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.389549 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260620 15:00:25.390918 433 heartbeater.cc:347] Connected to a master server at 127.12.116.190:36875
I20260620 15:00:25.391076 433 heartbeater.cc:464] Registering TS with master...
I20260620 15:00:25.391284 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 305
I20260620 15:00:25.391499 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal/instance
I20260620 15:00:25.391502 433 heartbeater.cc:511] Master 127.12.116.190:36875 requested a full tablet report, sending...
I20260620 15:00:25.391748 12754 external_mini_cluster.cc:1428] Setting key 9e2fa2e3b19133dc39fca4c9d188d84e
I20260620 15:00:25.392057 32451 ts_manager.cc:194] Registered new tserver with Master: 852e1ceb45c54f938eb2881e7fafdbde (127.12.116.131:45663)
I20260620 15:00:25.392599 32451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.116.131:56375
I20260620 15:00:25.392781 12754 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 15:00:25.399555 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.394568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44984 (local address 127.12.116.190:36875)
0620 15:00:25.394702 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.394705 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.394819 (+ 114us) server_negotiation.cc:407] Connection header received
0620 15:00:25.394984 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.394986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.395003 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.395071 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:25.395262 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.396187 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.397538 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.397919 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.398070 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.398992 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:25.398994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:25.398995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:25.399004 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:25.399027 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:25.399034 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:25.399118 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.399195 (+ 77us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.399247 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260620 15:00:25.402925 32451 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 15:00:25.405926 32451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 15:00:25.417685 448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.410842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.12.116.130:39227)
0620 15:00:25.411255 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.411259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.414068 (+ 2809us) server_negotiation.cc:407] Connection header received
0620 15:00:25.414123 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.414125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.414143 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.414224 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:25.414450 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.415281 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.416539 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.417105 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.417235 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.417346 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.417514 (+ 168us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.417565 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":85,"threads_started":1}
I20260620 15:00:25.417662 444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.410536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.130:39227 (local address 127.0.0.1:44292)
0620 15:00:25.412671 (+ 2135us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.412688 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.412762 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.414310 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.414311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.414313 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:25.414389 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.414391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.415448 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.415449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.416263 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.416266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.417243 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.417245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.417361 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.417379 (+ 18us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.417495 (+ 116us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.417565 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2117,"mutex_wait_us":4,"thread_start_us":116,"threads_started":1}
I20260620 15:00:25.418735 32704 tablet_service.cc:1467] Processing CreateTablet for tablet 39c7bebf8e3541879e6d3a089e35c553 (DEFAULT_TABLE table=test-table [id=207654b465a44a29a0349b090356de51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:25.419196 32704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39c7bebf8e3541879e6d3a089e35c553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:25.421957 445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.410534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:45663 (local address 127.0.0.1:47058)
0620 15:00:25.410870 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.410921 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.411016 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.412171 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.412174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.412178 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:25.412279 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.412281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.413710 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.413711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.415151 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.415154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.421606 (+ 6452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.421608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.421703 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.421709 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.421774 (+ 65us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.421854 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":4,"thread_start_us":124,"threads_started":1}
I20260620 15:00:25.422462 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.411030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47058 (local address 127.12.116.131:45663)
0620 15:00:25.411211 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.411215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.411227 (+ 12us) server_negotiation.cc:407] Connection header received
0620 15:00:25.411991 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.411993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.412011 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.412089 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:25.412419 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.413520 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.420480 (+ 6960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.421381 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.421475 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.421557 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.422316 (+ 759us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.422376 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260620 15:00:25.423113 450 tablet_bootstrap.cc:492] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Bootstrap starting.
I20260620 15:00:25.423731 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.410695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33912 (local address 127.12.116.129:45883)
0620 15:00:25.410942 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.410948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.410994 (+ 46us) server_negotiation.cc:407] Connection header received
0620 15:00:25.411552 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.411554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.411570 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.411800 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:25.412800 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.413901 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.415253 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.420933 (+ 5680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.421087 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.421206 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.421658 (+ 452us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.421760 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":129,"threads_started":1}
I20260620 15:00:25.423734 367 tablet_service.cc:1467] Processing CreateTablet for tablet 39c7bebf8e3541879e6d3a089e35c553 (DEFAULT_TABLE table=test-table [id=207654b465a44a29a0349b090356de51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:25.423943 450 tablet_bootstrap.cc:654] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:25.424247 450 log.cc:824] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:25.425271 367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39c7bebf8e3541879e6d3a089e35c553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:25.425566 450 tablet_bootstrap.cc:492] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: No bootstrap required, opened a new log
I20260620 15:00:25.425711 450 ts_tablet_manager.cc:1397] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260620 15:00:25.429073 446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.410308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:45883 (local address 127.0.0.1:33912)
0620 15:00:25.410870 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.410921 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.411016 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.412636 (+ 1620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.412637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.412641 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:25.412705 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.412708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.414041 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.414043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.415150 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.415154 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.421096 (+ 5942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.421098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.421186 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.421193 (+ 7us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.421268 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.421763 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":6,"thread_start_us":201,"threads_started":1}
I20260620 15:00:25.430742 452 tablet_bootstrap.cc:492] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Bootstrap starting.
I20260620 15:00:25.431012 32573 tablet_service.cc:1467] Processing CreateTablet for tablet 39c7bebf8e3541879e6d3a089e35c553 (DEFAULT_TABLE table=test-table [id=207654b465a44a29a0349b090356de51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 15:00:25.431620 32573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39c7bebf8e3541879e6d3a089e35c553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:25.431730 452 tablet_bootstrap.cc:654] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:25.432088 452 log.cc:824] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:25.433698 452 tablet_bootstrap.cc:492] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: No bootstrap required, opened a new log
I20260620 15:00:25.433809 452 ts_tablet_manager.cc:1397] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 15:00:25.437021 454 tablet_bootstrap.cc:492] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: Bootstrap starting.
I20260620 15:00:25.436962 452 raft_consensus.cc:348] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.437220 452 raft_consensus.cc:374] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:25.437279 452 raft_consensus.cc:729] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 852e1ceb45c54f938eb2881e7fafdbde, State: Initialized, Role: FOLLOWER
I20260620 15:00:25.437426 452 consensus_queue.cc:260] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.437920 433 heartbeater.cc:503] Master 127.12.116.190:36875 was elected leader, sending a full tablet report...
I20260620 15:00:25.437898 452 ts_tablet_manager.cc:1428] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260620 15:00:25.440135 454 tablet_bootstrap.cc:654] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:25.441584 454 log.cc:824] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:25.441671 450 raft_consensus.cc:348] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.441880 450 raft_consensus.cc:374] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:25.441921 450 raft_consensus.cc:729] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de03eccd85f446db9001cdb477f1c8a, State: Initialized, Role: FOLLOWER
I20260620 15:00:25.442147 450 consensus_queue.cc:260] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.442528 450 ts_tablet_manager.cc:1428] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Time spent starting tablet: real 0.016s user 0.004s sys 0.007s
I20260620 15:00:25.442602 302 heartbeater.cc:503] Master 127.12.116.190:36875 was elected leader, sending a full tablet report...
I20260620 15:00:25.443807 454 tablet_bootstrap.cc:492] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: No bootstrap required, opened a new log
I20260620 15:00:25.443919 454 ts_tablet_manager.cc:1397] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260620 15:00:25.447093 454 raft_consensus.cc:348] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.447335 454 raft_consensus.cc:374] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:25.447379 454 raft_consensus.cc:729] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dedd7a3dd814416f8fa8c6d95b6f4abd, State: Initialized, Role: FOLLOWER
I20260620 15:00:25.447533 454 consensus_queue.cc:260] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.447902 454 ts_tablet_manager.cc:1428] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260620 15:00:25.448065 32639 heartbeater.cc:503] Master 127.12.116.190:36875 was elected leader, sending a full tablet report...
W20260620 15:00:25.458904 303 tablet.cc:2369] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:25.489717 457 raft_consensus.cc:482] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:25.489936 457 raft_consensus.cc:504] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.490370 457 leader_election.cc:288] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 852e1ceb45c54f938eb2881e7fafdbde (127.12.116.131:45663), dedd7a3dd814416f8fa8c6d95b6f4abd (127.12.116.129:45883)
I20260620 15:00:25.494764 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.490744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:54281 (local address 127.12.116.129:45883)
0620 15:00:25.490879 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.490882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.490899 (+ 17us) server_negotiation.cc:407] Connection header received
0620 15:00:25.490955 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.490956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.490971 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.491238 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:25.491492 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.492503 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.493917 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.494374 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.494466 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.494476 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.494631 (+ 155us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.494679 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260620 15:00:25.494764 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.490607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:45883 (local address 127.12.116.130:54281)
0620 15:00:25.490679 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.490694 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.490765 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.491290 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.491292 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.491295 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:25.491378 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.491380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.492627 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.492630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.493793 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.493797 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.494466 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.494467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.494551 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.494555 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.494625 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.494683 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260620 15:00:25.495069 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.490906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.116.130:37255 (local address 127.12.116.131:45663)
0620 15:00:25.490970 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.490974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.491407 (+ 433us) server_negotiation.cc:407] Connection header received
0620 15:00:25.491490 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.491490 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.491502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.491597 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 15:00:25.492031 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.492744 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.494019 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.494606 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.494703 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.494717 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.494940 (+ 223us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.494999 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 15:00:25.495085 459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.490824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.131:45663 (local address 127.12.116.130:37255)
0620 15:00:25.491263 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.491278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.491362 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:25.491753 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:25.491754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:25.491757 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 15:00:25.491868 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.491870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.492833 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.492834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.493909 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:25.493912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.494727 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.494733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:25.494810 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.494813 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 15:00:25.494923 (+ 110us) client_negotiation.cc:240] Negotiation successful
0620 15:00:25.494972 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":292,"threads_started":1}
I20260620 15:00:25.495206 32593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c7bebf8e3541879e6d3a089e35c553" candidate_uuid: "8de03eccd85f446db9001cdb477f1c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" is_pre_election: true
I20260620 15:00:25.495393 32593 raft_consensus.cc:2454] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de03eccd85f446db9001cdb477f1c8a in term 0.
I20260620 15:00:25.495716 32658 leader_election.cc:302] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de03eccd85f446db9001cdb477f1c8a, dedd7a3dd814416f8fa8c6d95b6f4abd; no voters:
I20260620 15:00:25.495635 387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c7bebf8e3541879e6d3a089e35c553" candidate_uuid: "8de03eccd85f446db9001cdb477f1c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "852e1ceb45c54f938eb2881e7fafdbde" is_pre_election: true
I20260620 15:00:25.495887 457 raft_consensus.cc:2781] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 15:00:25.495898 387 raft_consensus.cc:2454] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de03eccd85f446db9001cdb477f1c8a in term 0.
I20260620 15:00:25.495954 457 raft_consensus.cc:482] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 15:00:25.495977 457 raft_consensus.cc:3037] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:25.497068 457 raft_consensus.cc:504] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.497268 457 leader_election.cc:288] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [CANDIDATE]: Term 1 election: Requested vote from peers 852e1ceb45c54f938eb2881e7fafdbde (127.12.116.131:45663), dedd7a3dd814416f8fa8c6d95b6f4abd (127.12.116.129:45883)
I20260620 15:00:25.497640 32593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c7bebf8e3541879e6d3a089e35c553" candidate_uuid: "8de03eccd85f446db9001cdb477f1c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd"
I20260620 15:00:25.497745 387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c7bebf8e3541879e6d3a089e35c553" candidate_uuid: "8de03eccd85f446db9001cdb477f1c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "852e1ceb45c54f938eb2881e7fafdbde"
I20260620 15:00:25.497766 32593 raft_consensus.cc:3037] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:25.497861 387 raft_consensus.cc:3037] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:25.498826 32593 raft_consensus.cc:2454] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de03eccd85f446db9001cdb477f1c8a in term 1.
I20260620 15:00:25.498826 387 raft_consensus.cc:2454] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de03eccd85f446db9001cdb477f1c8a in term 1.
I20260620 15:00:25.499140 32658 leader_election.cc:302] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de03eccd85f446db9001cdb477f1c8a, dedd7a3dd814416f8fa8c6d95b6f4abd; no voters:
I20260620 15:00:25.499291 457 raft_consensus.cc:2781] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:25.499536 457 raft_consensus.cc:686] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 1 LEADER]: Becoming Leader. State: Replica: 8de03eccd85f446db9001cdb477f1c8a, State: Running, Role: LEADER
I20260620 15:00:25.499662 457 consensus_queue.cc:237] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } }
I20260620 15:00:25.501092 32451 catalog_manager.cc:5495] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de03eccd85f446db9001cdb477f1c8a (127.12.116.130). New cstate: current_term: 1 leader_uuid: "8de03eccd85f446db9001cdb477f1c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de03eccd85f446db9001cdb477f1c8a" member_type: VOTER last_known_addr { host: "127.12.116.130" port: 39227 } health_report { overall_health: HEALTHY } } }
I20260620 15:00:25.519732 448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:25.516115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44306 (local address 127.12.116.130:39227)
0620 15:00:25.516240 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:25.516242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:25.516443 (+ 201us) server_negotiation.cc:407] Connection header received
0620 15:00:25.516516 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:25.516517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:25.516542 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:25.516633 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:25.516870 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.517388 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.518315 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:25.518515 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:25.518586 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:25.519068 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:25.519238 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:25.519343 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:25.519526 (+ 183us) server_negotiation.cc:299] Negotiation successful
0620 15:00:25.519562 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260620 15:00:25.523167 387 raft_consensus.cc:1261] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 1 FOLLOWER]: Refusing update from remote peer 8de03eccd85f446db9001cdb477f1c8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:25.523161 32593 raft_consensus.cc:1261] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 1 FOLLOWER]: Refusing update from remote peer 8de03eccd85f446db9001cdb477f1c8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:25.525331 460 consensus_queue.cc:1035] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "852e1ceb45c54f938eb2881e7fafdbde" member_type: VOTER last_known_addr { host: "127.12.116.131" port: 45663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:25.525729 457 consensus_queue.cc:1035] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dedd7a3dd814416f8fa8c6d95b6f4abd" member_type: VOTER last_known_addr { host: "127.12.116.129" port: 45883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:25.529682 463 mvcc.cc:205] Tried to move back new op lower bound from 7298939394138132480 to 7298939394047209472. Current Snapshot: MvccSnapshot[applied={T|T < 7298939394138132480}]
I20260620 15:00:25.533375 32451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:25.533501 32451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 15:00:25.534564 32451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4839e5600b6c4b018050a4e5728454d2: Sending DeleteTablet for 3 replicas of tablet 39c7bebf8e3541879e6d3a089e35c553
I20260620 15:00:25.534986 367 tablet_service.cc:1514] Processing DeleteTablet for tablet 39c7bebf8e3541879e6d3a089e35c553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:25 UTC) from {username='slave'} at 127.0.0.1:47058
I20260620 15:00:25.535625 32573 tablet_service.cc:1514] Processing DeleteTablet for tablet 39c7bebf8e3541879e6d3a089e35c553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:25 UTC) from {username='slave'} at 127.0.0.1:33912
I20260620 15:00:25.536185 474 tablet_replica.cc:330] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd: stopping tablet replica
I20260620 15:00:25.536309 473 tablet_replica.cc:330] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: stopping tablet replica
I20260620 15:00:25.536363 474 raft_consensus.cc:2229] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:25.536533 473 raft_consensus.cc:2229] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 15:00:25.536715 473 raft_consensus.cc:2258] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:25.536665 32704 tablet_service.cc:1514] Processing DeleteTablet for tablet 39c7bebf8e3541879e6d3a089e35c553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 15:00:25 UTC) from {username='slave'} at 127.0.0.1:44292
I20260620 15:00:25.536717 474 raft_consensus.cc:2258] T 39c7bebf8e3541879e6d3a089e35c553 P dedd7a3dd814416f8fa8c6d95b6f4abd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:25.538407 475 tablet_replica.cc:330] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: stopping tablet replica
I20260620 15:00:25.538625 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 32511
I20260620 15:00:25.538723 475 raft_consensus.cc:2229] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 1 LEADER]: Raft consensus shutting down.
I20260620 15:00:25.538875 475 raft_consensus.cc:2258] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 15:00:25.541491 475 ts_tablet_manager.cc:1905] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:25.546083 475 ts_tablet_manager.cc:1918] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:25.546229 475 log.cc:1196] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-1/wal/wals/39c7bebf8e3541879e6d3a089e35c553
I20260620 15:00:25.546553 475 ts_tablet_manager.cc:1939] T 39c7bebf8e3541879e6d3a089e35c553 P 8de03eccd85f446db9001cdb477f1c8a: Deleting consensus metadata
I20260620 15:00:25.547714 473 ts_tablet_manager.cc:1905] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 15:00:25.548211 32437 catalog_manager.cc:4841] TS 8de03eccd85f446db9001cdb477f1c8a (127.12.116.130:39227): tablet 39c7bebf8e3541879e6d3a089e35c553 (table test-table [id=207654b465a44a29a0349b090356de51]) successfully deleted
W20260620 15:00:25.548700 32436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.116.129:45883 (error 108)
W20260620 15:00:25.549383 446 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:25.549198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.129:45883 (local address 127.0.0.1:33914)
0620 15:00:25.549266 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:25.549280 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:25.549326 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.129:45883: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":44}
W20260620 15:00:25.549503 32436 catalog_manager.cc:4584] TS dedd7a3dd814416f8fa8c6d95b6f4abd (127.12.116.129:45883): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 39c7bebf8e3541879e6d3a089e35c553: Network error: Client connection negotiation failed: client connection to 127.12.116.129:45883: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260620 15:00:25.549947 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 32642
I20260620 15:00:25.554534 473 ts_tablet_manager.cc:1918] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 15:00:25.554675 473 log.cc:1196] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Deleting WAL directory at /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781967351633327-12754-0/minicluster-data/ts-2/wal/wals/39c7bebf8e3541879e6d3a089e35c553
I20260620 15:00:25.554941 473 ts_tablet_manager.cc:1939] T 39c7bebf8e3541879e6d3a089e35c553 P 852e1ceb45c54f938eb2881e7fafdbde: Deleting consensus metadata
I20260620 15:00:25.556512 32438 catalog_manager.cc:4841] TS 852e1ceb45c54f938eb2881e7fafdbde (127.12.116.131:45663): tablet 39c7bebf8e3541879e6d3a089e35c553 (table test-table [id=207654b465a44a29a0349b090356de51]) successfully deleted
I20260620 15:00:25.558151 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 305
I20260620 15:00:25.564217 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 32420
2026-06-20T15:00:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (918 ms)
[----------] 6 tests from EncryptionPolicyTest (10243 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:25 dist-test-slave-7v06 krb5kdc[479](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:25 dist-test-slave-7v06 krb5kdc[479](info): set up 2 sockets
Jun 20 15:00:25 dist-test-slave-7v06 krb5kdc[479](info): commencing operation
krb5kdc: starting...
W20260620 15:00:26.794224 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:26 dist-test-slave-7v06 krb5kdc[479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:26.963372 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34589
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:27.062758 492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:27.063092 492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:27.063139 492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:27.064671 492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:27.064785 492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:27.064811 492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:27.064836 492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:27.064867 492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:27.068295 492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34589
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:27.068805 492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:27.069103 492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:27.076362 498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:27.076370 497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:27.076364 500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:27.076421 492 server_base.cc:1034] running on GCE node
I20260620 15:00:27.077466 492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:27.077824 492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:27.079099 492 hybrid_clock.cc:648] HybridClock initialized: now 1781967627079066 us; error 41 us; skew 500 ppm
Jun 20 15:00:27 dist-test-slave-7v06 krb5kdc[479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:27.085220 492 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:27.086212 492 webserver.cc:460] Webserver started at http://127.0.0.1:36825/ using document root <none> and password file <none>
I20260620 15:00:27.086519 492 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:27.086611 492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:27.086778 492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:27.088147 492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "fa4a7f3fded74aa38c1f9625631ac4dc"
format_stamp: "Formatted at 2026-06-20 15:00:27 on dist-test-slave-7v06"
server_key: "f6c5c938abe1799f464f5d208500d878"
server_key_iv: "9c294c68f63b31cd3e2c01162a3db104"
server_key_version: "encryptionkey@0"
I20260620 15:00:27.088959 492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "fa4a7f3fded74aa38c1f9625631ac4dc"
format_stamp: "Formatted at 2026-06-20 15:00:27 on dist-test-slave-7v06"
server_key: "f6c5c938abe1799f464f5d208500d878"
server_key_iv: "9c294c68f63b31cd3e2c01162a3db104"
server_key_version: "encryptionkey@0"
I20260620 15:00:27.092000 492 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 15:00:27.093830 507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:27.094214 492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:27.094354 492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "fa4a7f3fded74aa38c1f9625631ac4dc"
format_stamp: "Formatted at 2026-06-20 15:00:27 on dist-test-slave-7v06"
server_key: "f6c5c938abe1799f464f5d208500d878"
server_key_iv: "9c294c68f63b31cd3e2c01162a3db104"
server_key_version: "encryptionkey@0"
I20260620 15:00:27.094435 492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:27.116892 492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:27.120563 492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:27.120903 492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:27.127592 492 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34589
I20260620 15:00:27.127676 559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34589 every 8 connection(s)
I20260620 15:00:27.128089 492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:27.129254 560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:27.131881 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 492
I20260620 15:00:27.132012 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:27.132246 12754 external_mini_cluster.cc:1428] Setting key dcefe31281cb53b56c65770aaf2af252
I20260620 15:00:27.133054 560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc: Bootstrap starting.
I20260620 15:00:27.134222 560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:27.134621 560 log.cc:824] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:27.135749 560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc: No bootstrap required, opened a new log
I20260620 15:00:27.138000 560 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34589 } }
I20260620 15:00:27.138294 560 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:27.138345 560 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4a7f3fded74aa38c1f9625631ac4dc, State: Initialized, Role: FOLLOWER
I20260620 15:00:27.138558 560 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34589 } }
I20260620 15:00:27.138669 560 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:27.138717 560 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:27.138777 560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:27.139734 560 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34589 } }
I20260620 15:00:27.139869 560 leader_election.cc:302] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa4a7f3fded74aa38c1f9625631ac4dc; no voters:
I20260620 15:00:27.140126 560 leader_election.cc:288] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:27.140280 565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:27.140609 565 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [term 1 LEADER]: Becoming Leader. State: Replica: fa4a7f3fded74aa38c1f9625631ac4dc, State: Running, Role: LEADER
I20260620 15:00:27.140787 565 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34589 } }
I20260620 15:00:27.140880 560 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:27.141330 565 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa4a7f3fded74aa38c1f9625631ac4dc. Latest consensus state: current_term: 1 leader_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34589 } } }
I20260620 15:00:27.141436 565 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:27.142190 566 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa4a7f3fded74aa38c1f9625631ac4dc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34589 } } }
I20260620 15:00:27.142339 566 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc [sys.catalog]: This master's current role is: LEADER
Jun 20 15:00:27 dist-test-slave-7v06 krb5kdc[479](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260620 15:00:27.143332 580 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:27.143402 580 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:27.143466 572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:27.143687 572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:27.146734 572 catalog_manager.cc:1347] Generated new cluster ID: a561a7e1e1464d9a906ca2992e2118d9
I20260620 15:00:27.147033 572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:27.151217 563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:27.133074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50671 (local address 127.0.0.1:34589)
0620 15:00:27.133519 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:27.133530 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:27.133565 (+ 35us) server_negotiation.cc:407] Connection header received
0620 15:00:27.134162 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:27.134170 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:27.134232 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:27.134489 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:27.135669 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:27.137579 (+ 1910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:27.138814 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:27.139532 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:27.139776 (+ 244us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:27.143915 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:27.143921 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:27.143922 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:27.143939 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:27.147766 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:27.148632 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:27.148640 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:27.148640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:27.148791 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:27.149126 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:27.149127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:27.149128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:27.149559 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:27.150593 (+ 1034us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:27.150748 (+ 155us) server_negotiation.cc:299] Negotiation successful
0620 15:00:27.150921 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":282,"threads_started":1}
I20260620 15:00:27.154661 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:27.168922 572 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:27.169718 572 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:27.173650 572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa4a7f3fded74aa38c1f9625631ac4dc: Generated new TSK 0
I20260620 15:00:27.173885 572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:27.175840 563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:27.156787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41873 (local address 127.0.0.1:34589)
0620 15:00:27.156836 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:27.156838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:27.164597 (+ 7759us) server_negotiation.cc:407] Connection header received
0620 15:00:27.164645 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:27.164647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:27.164662 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:27.164760 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:27.165569 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:27.167110 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:27.168286 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:27.168719 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:27.168805 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:27.170907 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:27.170909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:27.170909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:27.170918 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:27.172833 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:27.173442 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:27.173444 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:27.173444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:27.173820 (+ 376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:27.174565 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:27.174566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:27.174566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:27.174726 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:27.174836 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:27.175455 (+ 619us) server_negotiation.cc:299] Negotiation successful
0620 15:00:27.175563 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 15:00:27.179697 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 492
W20260620 15:00:27.184859 477 connection.cc:535] client connection to 127.0.0.1:34589 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34589): Connection reset by peer (error 104)
2026-06-20T15:00:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1613 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:27 dist-test-slave-7v06 krb5kdc[591](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:27 dist-test-slave-7v06 krb5kdc[591](info): set up 2 sockets
Jun 20 15:00:27 dist-test-slave-7v06 krb5kdc[591](info): commencing operation
krb5kdc: starting...
W20260620 15:00:28.300814 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:28 dist-test-slave-7v06 krb5kdc[591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:28.433665 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44921
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:28.531031 604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:28.531374 604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:28.531407 604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:28.534065 604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:28.534176 604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:28.534194 604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:28.534209 604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:28.534224 604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:28.536293 604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44921
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:28.536679 604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:28.536954 604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:28.543821 610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:28.543821 609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:28.543869 612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:28.544999 604 server_base.cc:1034] running on GCE node
I20260620 15:00:28.545447 604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:28.545957 604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:28.547221 604 hybrid_clock.cc:648] HybridClock initialized: now 1781967628547196 us; error 43 us; skew 500 ppm
Jun 20 15:00:28 dist-test-slave-7v06 krb5kdc[591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967628, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:28.551462 604 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:28.552023 604 webserver.cc:460] Webserver started at http://127.0.0.1:34603/ using document root <none> and password file <none>
I20260620 15:00:28.552701 604 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:28.552799 604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:28.552989 604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:28.554358 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "4fcf3099a46e4e5192088d30c8fed8c3"
format_stamp: "Formatted at 2026-06-20 15:00:28 on dist-test-slave-7v06"
server_key: "eb6da9c69aca86104553f4d671b3d902"
server_key_iv: "be530e34fd153921562f1b0547e375f5"
server_key_version: "encryptionkey@0"
I20260620 15:00:28.554770 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "4fcf3099a46e4e5192088d30c8fed8c3"
format_stamp: "Formatted at 2026-06-20 15:00:28 on dist-test-slave-7v06"
server_key: "eb6da9c69aca86104553f4d671b3d902"
server_key_iv: "be530e34fd153921562f1b0547e375f5"
server_key_version: "encryptionkey@0"
I20260620 15:00:28.556818 604 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:28.557879 619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:28.558315 604 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:28.558413 604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "4fcf3099a46e4e5192088d30c8fed8c3"
format_stamp: "Formatted at 2026-06-20 15:00:28 on dist-test-slave-7v06"
server_key: "eb6da9c69aca86104553f4d671b3d902"
server_key_iv: "be530e34fd153921562f1b0547e375f5"
server_key_version: "encryptionkey@0"
I20260620 15:00:28.558561 604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:28.577018 604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:28.580694 604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:28.580899 604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:28.585712 604 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44921
I20260620 15:00:28.585749 671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44921 every 8 connection(s)
I20260620 15:00:28.586148 604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:28.587193 672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:28.590227 672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3: Bootstrap starting.
I20260620 15:00:28.590961 672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:28.590999 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 604
I20260620 15:00:28.591177 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:28.591320 672 log.cc:824] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:28.591404 12754 external_mini_cluster.cc:1428] Setting key c14783ecb0e0ac3a6f79defc5b99f328
I20260620 15:00:28.592206 672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3: No bootstrap required, opened a new log
I20260620 15:00:28.595130 672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44921 } }
I20260620 15:00:28.595359 672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:28.595417 672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fcf3099a46e4e5192088d30c8fed8c3, State: Initialized, Role: FOLLOWER
I20260620 15:00:28.595618 672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44921 } }
I20260620 15:00:28.595726 672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:28.595768 672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:28.595824 672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:28.596711 672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44921 } }
I20260620 15:00:28.596869 672 leader_election.cc:302] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fcf3099a46e4e5192088d30c8fed8c3; no voters:
I20260620 15:00:28.597074 672 leader_election.cc:288] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:28.597203 677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:28.597364 677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [term 1 LEADER]: Becoming Leader. State: Replica: 4fcf3099a46e4e5192088d30c8fed8c3, State: Running, Role: LEADER
I20260620 15:00:28.597462 677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44921 } }
I20260620 15:00:28.597884 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:28.592089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56617 (local address 127.0.0.1:44921)
0620 15:00:28.592283 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:28.592294 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:28.592362 (+ 68us) server_negotiation.cc:407] Connection header received
0620 15:00:28.592886 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:28.592893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:28.592948 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:28.593132 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:28.593336 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:28.594319 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:28.595130 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:28.595991 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:28.596141 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:28.596979 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:28.596984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:28.596984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:28.597220 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:28.597272 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:28.597289 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:28.597573 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:28.597631 (+ 58us) server_negotiation.cc:299] Negotiation successful
0620 15:00:28.597662 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
I20260620 15:00:28.597460 672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:28.598004 678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44921 } } }
I20260620 15:00:28.598251 678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:28.599269 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:28.599457 679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fcf3099a46e4e5192088d30c8fed8c3. Latest consensus state: current_term: 1 leader_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fcf3099a46e4e5192088d30c8fed8c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44921 } } }
I20260620 15:00:28.599537 679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:28.601238 682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:28.601948 682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:28.603924 682 catalog_manager.cc:1347] Generated new cluster ID: 2bd3f3e3535246dd88147ec16c6c5316
I20260620 15:00:28.604007 682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:28.605094 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:28.600881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35525 (local address 127.0.0.1:44921)
0620 15:00:28.600920 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:28.600922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:28.601037 (+ 115us) server_negotiation.cc:407] Connection header received
0620 15:00:28.601104 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:28.601105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:28.601131 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:28.601200 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:28.601465 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:28.602298 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:28.603388 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:28.603704 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:28.603789 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:28.604785 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:28.604786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:28.604787 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:28.604793 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:28.604812 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:28.604817 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:28.604877 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:28.604996 (+ 119us) server_negotiation.cc:299] Negotiation successful
0620 15:00:28.605009 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 15:00:28.612351 682 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:28.613094 682 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:28.622408 682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fcf3099a46e4e5192088d30c8fed8c3: Generated new TSK 0
I20260620 15:00:28.622664 682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:28.627310 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 604
W20260620 15:00:28.631623 589 connection.cc:535] client connection to 127.0.0.1:44921 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44921): Connection reset by peer (error 104)
2026-06-20T15:00:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1445 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:28 dist-test-slave-7v06 krb5kdc[703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:28 dist-test-slave-7v06 krb5kdc[703](info): set up 2 sockets
Jun 20 15:00:28 dist-test-slave-7v06 krb5kdc[703](info): commencing operation
krb5kdc: starting...
W20260620 15:00:29.772933 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:29 dist-test-slave-7v06 krb5kdc[703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:29.926245 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45901
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:30.051039 716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:30.051358 716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:30.051405 716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:30.052999 716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:30.053107 716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:30.053133 716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:30.053155 716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:30.053182 716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:30.055068 716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45901
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:30.055476 716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:30.055759 716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:30.069365 722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:30.069365 724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:30.069406 721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:30.069494 716 server_base.cc:1034] running on GCE node
I20260620 15:00:30.070559 716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:30.070976 716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:30.072214 716 hybrid_clock.cc:648] HybridClock initialized: now 1781967630072190 us; error 48 us; skew 500 ppm
Jun 20 15:00:30 dist-test-slave-7v06 krb5kdc[703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967630, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:30.075562 716 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:30.077755 716 webserver.cc:460] Webserver started at http://127.0.0.1:38425/ using document root <none> and password file <none>
I20260620 15:00:30.078014 716 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:30.078058 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:30.078255 716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:30.080669 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "f38f79daa79148bf9958a9f52afd4212"
format_stamp: "Formatted at 2026-06-20 15:00:30 on dist-test-slave-7v06"
server_key: "a8acce0d1dfbd7c7ced7603d68a250fe"
server_key_iv: "2b3c833b1b69b0fa1e79ff22edb4026c"
server_key_version: "encryptionkey@0"
I20260620 15:00:30.081816 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "f38f79daa79148bf9958a9f52afd4212"
format_stamp: "Formatted at 2026-06-20 15:00:30 on dist-test-slave-7v06"
server_key: "a8acce0d1dfbd7c7ced7603d68a250fe"
server_key_iv: "2b3c833b1b69b0fa1e79ff22edb4026c"
server_key_version: "encryptionkey@0"
I20260620 15:00:30.084412 716 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260620 15:00:30.085924 731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:30.086297 716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:30.086419 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "f38f79daa79148bf9958a9f52afd4212"
format_stamp: "Formatted at 2026-06-20 15:00:30 on dist-test-slave-7v06"
server_key: "a8acce0d1dfbd7c7ced7603d68a250fe"
server_key_iv: "2b3c833b1b69b0fa1e79ff22edb4026c"
server_key_version: "encryptionkey@0"
I20260620 15:00:30.086500 716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:30.090473 716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:30.093833 716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:30.094058 716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:30.108472 716 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45901
I20260620 15:00:30.108532 783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45901 every 8 connection(s)
I20260620 15:00:30.108966 716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:30.110066 784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:30.113286 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212: Bootstrap starting.
I20260620 15:00:30.114184 784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:30.114791 784 log.cc:824] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:30.116679 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 716
I20260620 15:00:30.116807 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:30.116943 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212: No bootstrap required, opened a new log
I20260620 15:00:30.116964 12754 external_mini_cluster.cc:1428] Setting key 8286e42737d1fdede4fd4a1742887ad4
I20260620 15:00:30.121829 784 raft_consensus.cc:348] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f79daa79148bf9958a9f52afd4212" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45901 } }
I20260620 15:00:30.122115 784 raft_consensus.cc:374] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:30.122175 784 raft_consensus.cc:729] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38f79daa79148bf9958a9f52afd4212, State: Initialized, Role: FOLLOWER
I20260620 15:00:30.122359 784 consensus_queue.cc:260] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f79daa79148bf9958a9f52afd4212" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45901 } }
I20260620 15:00:30.122479 784 raft_consensus.cc:388] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:30.122506 784 raft_consensus.cc:482] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:30.122654 784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:30.123824 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:30.117956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33345 (local address 127.0.0.1:45901)
0620 15:00:30.119104 (+ 1148us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:30.119117 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:30.119178 (+ 61us) server_negotiation.cc:407] Connection header received
0620 15:00:30.120791 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:30.120805 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:30.120855 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:30.121093 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:30.122002 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:30.122006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:30.122007 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:30.122013 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:30.122070 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:30.122087 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:30.122182 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:30.122632 (+ 450us) server_negotiation.cc:299] Negotiation successful
0620 15:00:30.122851 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":972,"thread_start_us":451,"threads_started":1}
I20260620 15:00:30.124637 784 raft_consensus.cc:504] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f79daa79148bf9958a9f52afd4212" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45901 } }
I20260620 15:00:30.124804 784 leader_election.cc:302] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f38f79daa79148bf9958a9f52afd4212; no voters:
I20260620 15:00:30.125236 784 leader_election.cc:288] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:30.125450 789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:30.125988 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:30.126027 784 sys_catalog.cc:564] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:30.126088 789 raft_consensus.cc:686] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [term 1 LEADER]: Becoming Leader. State: Replica: f38f79daa79148bf9958a9f52afd4212, State: Running, Role: LEADER
I20260620 15:00:30.126240 789 consensus_queue.cc:237] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f79daa79148bf9958a9f52afd4212" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45901 } }
I20260620 15:00:30.126621 789 sys_catalog.cc:455] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f38f79daa79148bf9958a9f52afd4212. Latest consensus state: current_term: 1 leader_uuid: "f38f79daa79148bf9958a9f52afd4212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f79daa79148bf9958a9f52afd4212" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45901 } } }
I20260620 15:00:30.126739 789 sys_catalog.cc:458] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:30.127018 798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:30.127192 790 sys_catalog.cc:455] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f38f79daa79148bf9958a9f52afd4212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f79daa79148bf9958a9f52afd4212" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45901 } } }
I20260620 15:00:30.127336 790 sys_catalog.cc:458] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:30.127689 798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:30.129846 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:30.128404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34955 (local address 127.0.0.1:45901)
0620 15:00:30.128449 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:30.128452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:30.128739 (+ 287us) server_negotiation.cc:407] Connection header received
0620 15:00:30.128797 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:30.128798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:30.128806 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:30.128868 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:30.129588 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:30.129590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:30.129591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:30.129596 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:30.129611 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:30.129616 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:30.129667 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:30.129736 (+ 69us) server_negotiation.cc:299] Negotiation successful
0620 15:00:30.129752 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 15:00:30.130100 798 catalog_manager.cc:1347] Generated new cluster ID: 58bffe090bd9431589522ea21162b66d
I20260620 15:00:30.130151 798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:30.137676 798 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:30.138460 798 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:30.145489 798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f38f79daa79148bf9958a9f52afd4212: Generated new TSK 0
I20260620 15:00:30.145984 798 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:30.149776 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 716
2026-06-20T15:00:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:30 dist-test-slave-7v06 krb5kdc[815](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:30 dist-test-slave-7v06 krb5kdc[815](info): set up 2 sockets
Jun 20 15:00:30 dist-test-slave-7v06 krb5kdc[815](info): commencing operation
krb5kdc: starting...
W20260620 15:00:31.301115 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:31 dist-test-slave-7v06 krb5kdc[815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:31.459996 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45243
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:31.560738 828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:31.561038 828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:31.561088 828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:31.562548 828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:31.562647 828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:31.562671 828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:31.562691 828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:31.562824 828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:31.564978 828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:31.565367 828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:31.565946 828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:31.572712 833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:31.572847 828 server_base.cc:1034] running on GCE node
W20260620 15:00:31.572755 834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:31.572953 836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:31.573447 828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:31.574008 828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:31.575369 828 hybrid_clock.cc:648] HybridClock initialized: now 1781967631575326 us; error 58 us; skew 500 ppm
Jun 20 15:00:31 dist-test-slave-7v06 krb5kdc[815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:31.583148 828 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:31.583819 828 webserver.cc:460] Webserver started at http://127.0.0.1:40665/ using document root <none> and password file <none>
I20260620 15:00:31.584301 828 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:31.584527 828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:31.584702 828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:31.586036 828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "759c79a69c2e40c986241bd89bc15521"
format_stamp: "Formatted at 2026-06-20 15:00:31 on dist-test-slave-7v06"
server_key: "f9d0e2aff06886cc5f63565c125a1c08"
server_key_iv: "7763515134400d70331c8fea463f5f41"
server_key_version: "encryptionkey@0"
I20260620 15:00:31.586625 828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "759c79a69c2e40c986241bd89bc15521"
format_stamp: "Formatted at 2026-06-20 15:00:31 on dist-test-slave-7v06"
server_key: "f9d0e2aff06886cc5f63565c125a1c08"
server_key_iv: "7763515134400d70331c8fea463f5f41"
server_key_version: "encryptionkey@0"
I20260620 15:00:31.588660 828 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260620 15:00:31.590042 843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:31.590310 828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:31.590689 828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "759c79a69c2e40c986241bd89bc15521"
format_stamp: "Formatted at 2026-06-20 15:00:31 on dist-test-slave-7v06"
server_key: "f9d0e2aff06886cc5f63565c125a1c08"
server_key_iv: "7763515134400d70331c8fea463f5f41"
server_key_version: "encryptionkey@0"
I20260620 15:00:31.590853 828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:31.616210 828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:31.619271 828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:31.619472 828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:31.625347 828 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45243
I20260620 15:00:31.625367 895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45243 every 8 connection(s)
I20260620 15:00:31.626730 828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:31.627729 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 828
I20260620 15:00:31.627892 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:31.628320 12754 external_mini_cluster.cc:1428] Setting key d3fac885da42ace675497c7638703622
I20260620 15:00:31.628396 896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:31.633467 896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521: Bootstrap starting.
I20260620 15:00:31.634958 896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:31.635684 896 log.cc:824] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:31.636943 896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521: No bootstrap required, opened a new log
Jun 20 15:00:31 dist-test-slave-7v06 krb5kdc[815](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 15:00:31.639272 896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c79a69c2e40c986241bd89bc15521" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260620 15:00:31.639489 896 raft_consensus.cc:374] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:31.639544 896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 759c79a69c2e40c986241bd89bc15521, State: Initialized, Role: FOLLOWER
I20260620 15:00:31.639736 896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c79a69c2e40c986241bd89bc15521" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260620 15:00:31.639843 896 raft_consensus.cc:388] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:31.639911 896 raft_consensus.cc:482] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:31.640033 896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:31.641111 896 raft_consensus.cc:504] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c79a69c2e40c986241bd89bc15521" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260620 15:00:31.641245 896 leader_election.cc:302] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 759c79a69c2e40c986241bd89bc15521; no voters:
I20260620 15:00:31.642078 896 leader_election.cc:288] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:31.642305 901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:31.642500 896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:31.642678 901 raft_consensus.cc:686] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [term 1 LEADER]: Becoming Leader. State: Replica: 759c79a69c2e40c986241bd89bc15521, State: Running, Role: LEADER
I20260620 15:00:31.643132 901 consensus_queue.cc:237] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c79a69c2e40c986241bd89bc15521" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } }
I20260620 15:00:31.644909 902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "759c79a69c2e40c986241bd89bc15521" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c79a69c2e40c986241bd89bc15521" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } } }
I20260620 15:00:31.645733 902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:31.645182 903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 759c79a69c2e40c986241bd89bc15521. Latest consensus state: current_term: 1 leader_uuid: "759c79a69c2e40c986241bd89bc15521" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c79a69c2e40c986241bd89bc15521" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45243 } } }
W20260620 15:00:31.645352 915 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260620 15:00:31.645856 903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521 [sys.catalog]: This master's current role is: LEADER
W20260620 15:00:31.645892 915 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:31.646240 918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:31.646464 918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:31.647969 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:31.629475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50055 (local address 127.0.0.1:45243)
0620 15:00:31.629718 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:31.629729 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:31.629764 (+ 35us) server_negotiation.cc:407] Connection header received
0620 15:00:31.630726 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:31.630735 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:31.630802 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:31.630952 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:31.632108 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:31.633406 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:31.635445 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:31.636087 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:31.636269 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:31.640027 (+ 3758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:31.640035 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:31.640036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:31.640056 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:31.643282 (+ 3226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:31.644535 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:31.644541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:31.644541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:31.644722 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:31.645062 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:31.645064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:31.645064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:31.645457 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:31.645657 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:31.647204 (+ 1547us) server_negotiation.cc:299] Negotiation successful
0620 15:00:31.647464 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":116,"threads_started":1}
I20260620 15:00:31.649748 918 catalog_manager.cc:1347] Generated new cluster ID: b6c17c712db24de99cae370085b8b4a9
I20260620 15:00:31.649896 918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:31.650189 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:31.657438 918 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:31.658216 918 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:31.661707 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:31.652530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34583 (local address 127.0.0.1:45243)
0620 15:00:31.652594 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:31.652597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:31.652764 (+ 167us) server_negotiation.cc:407] Connection header received
0620 15:00:31.652811 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:31.652812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:31.652825 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:31.652902 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:31.653621 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:31.654471 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:31.655572 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:31.655929 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:31.656015 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:31.657838 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:31.657840 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:31.657840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:31.657850 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:31.659749 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:31.660538 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:31.660541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:31.660541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:31.660632 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:31.661051 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:31.661052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:31.661052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:31.661217 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:31.661333 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:31.661477 (+ 144us) server_negotiation.cc:299] Negotiation successful
0620 15:00:31.661598 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 15:00:31.666564 918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 759c79a69c2e40c986241bd89bc15521: Generated new TSK 0
I20260620 15:00:31.666877 918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:31.674928 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 828
2026-06-20T15:00:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1526 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:31 dist-test-slave-7v06 krb5kdc[927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:31 dist-test-slave-7v06 krb5kdc[927](info): set up 2 sockets
Jun 20 15:00:31 dist-test-slave-7v06 krb5kdc[927](info): commencing operation
krb5kdc: starting...
W20260620 15:00:32.801386 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:32 dist-test-slave-7v06 krb5kdc[927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:32.957897 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:33.051723 940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:33.052038 940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:33.052084 940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:33.053740 940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:33.053848 940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:33.053876 940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:33.053900 940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:33.053933 940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:33.055801 940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:33.056159 940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:33.056489 940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:33.062892 948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:33.067566 946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:33.067776 945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:33.069165 940 server_base.cc:1034] running on GCE node
I20260620 15:00:33.069759 940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:33.070201 940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:33.071393 940 hybrid_clock.cc:648] HybridClock initialized: now 1781967633071355 us; error 56 us; skew 500 ppm
Jun 20 15:00:33 dist-test-slave-7v06 krb5kdc[927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967633, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:33.074875 940 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:33.075353 940 webserver.cc:460] Webserver started at http://127.0.0.1:37427/ using document root <none> and password file <none>
I20260620 15:00:33.075644 940 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:33.075803 940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:33.075968 940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:33.077271 940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "50a34d31b73f42cd9898364cae97cf78"
format_stamp: "Formatted at 2026-06-20 15:00:33 on dist-test-slave-7v06"
server_key: "616e72a7e25de5558d9ee5e48bf0f457"
server_key_iv: "a64e47d5b7eaafa38d2d13ff2246a8f5"
server_key_version: "encryptionkey@0"
I20260620 15:00:33.077698 940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "50a34d31b73f42cd9898364cae97cf78"
format_stamp: "Formatted at 2026-06-20 15:00:33 on dist-test-slave-7v06"
server_key: "616e72a7e25de5558d9ee5e48bf0f457"
server_key_iv: "a64e47d5b7eaafa38d2d13ff2246a8f5"
server_key_version: "encryptionkey@0"
I20260620 15:00:33.079171 940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:33.080202 955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:33.080516 940 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:33.080675 940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "50a34d31b73f42cd9898364cae97cf78"
format_stamp: "Formatted at 2026-06-20 15:00:33 on dist-test-slave-7v06"
server_key: "616e72a7e25de5558d9ee5e48bf0f457"
server_key_iv: "a64e47d5b7eaafa38d2d13ff2246a8f5"
server_key_version: "encryptionkey@0"
I20260620 15:00:33.080758 940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:33.093739 940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:33.096768 940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:33.096921 940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:33.101927 940 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41711
I20260620 15:00:33.102404 940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:33.102380 1007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41711 every 8 connection(s)
I20260620 15:00:33.103348 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:33.106065 1008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78: Bootstrap starting.
I20260620 15:00:33.106784 1008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:33.107115 1008 log.cc:824] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:33.108214 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 940
I20260620 15:00:33.108392 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:33.108650 12754 external_mini_cluster.cc:1428] Setting key 4b44588dc877cf7fa7b4cfcea1dade7d
I20260620 15:00:33.108803 1008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78: No bootstrap required, opened a new log
I20260620 15:00:33.113130 1008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } }
I20260620 15:00:33.113417 1008 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:33.113476 1008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a34d31b73f42cd9898364cae97cf78, State: Initialized, Role: FOLLOWER
I20260620 15:00:33.113761 1008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } }
I20260620 15:00:33.113894 1013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 15:00:33.113992 1013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } }
I20260620 15:00:33.113873 1008 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:33.114156 1008 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:33.114127 1013 leader_election.cc:302] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50a34d31b73f42cd9898364cae97cf78; no voters:
I20260620 15:00:33.114207 1008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:33.114336 1013 leader_election.cc:288] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260620 15:00:33.115000 1008 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } }
I20260620 15:00:33.115108 1008 leader_election.cc:302] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50a34d31b73f42cd9898364cae97cf78; no voters:
I20260620 15:00:33.115164 1014 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260620 15:00:33.115175 1008 leader_election.cc:288] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:33.115437 1013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:33.115404 1014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } } }
I20260620 15:00:33.115593 1013 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [term 1 LEADER]: Becoming Leader. State: Replica: 50a34d31b73f42cd9898364cae97cf78, State: Running, Role: LEADER
I20260620 15:00:33.115613 1008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:33.115636 1014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:33.115818 1013 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } }
I20260620 15:00:33.116262 1014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50a34d31b73f42cd9898364cae97cf78. Latest consensus state: current_term: 1 leader_uuid: "50a34d31b73f42cd9898364cae97cf78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50a34d31b73f42cd9898364cae97cf78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41711 } } }
I20260620 15:00:33.116438 1014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:33.117086 1012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:33.109458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39433 (local address 127.0.0.1:41711)
0620 15:00:33.109735 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:33.109747 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:33.109792 (+ 45us) server_negotiation.cc:407] Connection header received
0620 15:00:33.110572 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:33.110582 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:33.110663 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:33.110843 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:33.111209 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:33.113103 (+ 1894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:33.114358 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:33.114896 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:33.114968 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:33.116083 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:33.116088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:33.116089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:33.116335 (+ 246us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:33.116403 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:33.116422 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:33.116490 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:33.116748 (+ 258us) server_negotiation.cc:299] Negotiation successful
0620 15:00:33.116827 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":107,"threads_started":1}
I20260620 15:00:33.117434 1022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:33.118181 1022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:33.119093 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:33.121191 1022 catalog_manager.cc:1347] Generated new cluster ID: 6ffcb14340594fa9ad5ed58836161549
I20260620 15:00:33.121263 1022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:33.124032 1012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:33.120795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36413 (local address 127.0.0.1:41711)
0620 15:00:33.120838 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:33.120840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:33.120992 (+ 152us) server_negotiation.cc:407] Connection header received
0620 15:00:33.121073 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:33.121074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:33.121086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:33.121194 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:33.121383 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:33.121904 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:33.122668 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:33.122894 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:33.122985 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:33.123761 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:33.123762 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:33.123762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:33.123768 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:33.123785 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:33.123789 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:33.123843 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:33.123908 (+ 65us) server_negotiation.cc:299] Negotiation successful
0620 15:00:33.123936 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 15:00:33.149724 1022 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:33.150892 1022 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:33.163648 1022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50a34d31b73f42cd9898364cae97cf78: Generated new TSK 0
I20260620 15:00:33.163900 1022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:33.166694 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 940
2026-06-20T15:00:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:33 dist-test-slave-7v06 krb5kdc[1039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:33 dist-test-slave-7v06 krb5kdc[1039](info): set up 2 sockets
Jun 20 15:00:33 dist-test-slave-7v06 krb5kdc[1039](info): commencing operation
krb5kdc: starting...
W20260620 15:00:34.316646 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:34 dist-test-slave-7v06 krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:34.474042 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46107
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:34.569713 1052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:34.570120 1052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:34.570166 1052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:34.571573 1052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:34.571657 1052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:34.571683 1052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:34.571707 1052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:34.571735 1052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:34.573810 1052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:34.574198 1052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:34.574472 1052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 15:00:34.580106 1052 server_base.cc:1034] running on GCE node
W20260620 15:00:34.580082 1057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:34.580140 1060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:34.580075 1058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:34.580827 1052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:34.581194 1052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:34.582377 1052 hybrid_clock.cc:648] HybridClock initialized: now 1781967634582346 us; error 47 us; skew 500 ppm
Jun 20 15:00:34 dist-test-slave-7v06 krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967634, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:34.585392 1052 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:34.585933 1052 webserver.cc:460] Webserver started at http://127.0.0.1:39809/ using document root <none> and password file <none>
I20260620 15:00:34.586202 1052 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:34.586253 1052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:34.586431 1052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:34.587591 1052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "d8c8bac6555849b480177f7d315fbe7a"
format_stamp: "Formatted at 2026-06-20 15:00:34 on dist-test-slave-7v06"
server_key: "85093c7366fe67a7e0da833b7e2f2b6b"
server_key_iv: "1fd19e8dae38730071d05bcd984f360d"
server_key_version: "encryptionkey@0"
I20260620 15:00:34.587990 1052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "d8c8bac6555849b480177f7d315fbe7a"
format_stamp: "Formatted at 2026-06-20 15:00:34 on dist-test-slave-7v06"
server_key: "85093c7366fe67a7e0da833b7e2f2b6b"
server_key_iv: "1fd19e8dae38730071d05bcd984f360d"
server_key_version: "encryptionkey@0"
I20260620 15:00:34.589556 1052 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 15:00:34.590449 1067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:34.590807 1052 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 15:00:34.590916 1052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "d8c8bac6555849b480177f7d315fbe7a"
format_stamp: "Formatted at 2026-06-20 15:00:34 on dist-test-slave-7v06"
server_key: "85093c7366fe67a7e0da833b7e2f2b6b"
server_key_iv: "1fd19e8dae38730071d05bcd984f360d"
server_key_version: "encryptionkey@0"
I20260620 15:00:34.591009 1052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:34.594679 1052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:34.597640 1052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:34.598379 1052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:34.604266 1052 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46107
I20260620 15:00:34.604386 1119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46107 every 8 connection(s)
I20260620 15:00:34.604745 1052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:34.605777 1120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:34.608158 1120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a: Bootstrap starting.
I20260620 15:00:34.608848 1120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:34.609244 1120 log.cc:824] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:34.610003 1120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a: No bootstrap required, opened a new log
I20260620 15:00:34.611235 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1052
I20260620 15:00:34.611395 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:34.611591 12754 external_mini_cluster.cc:1428] Setting key af2316594cd44d8dcaf0a91154050141
I20260620 15:00:34.611835 1120 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c8bac6555849b480177f7d315fbe7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260620 15:00:34.612048 1120 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:34.612093 1120 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c8bac6555849b480177f7d315fbe7a, State: Initialized, Role: FOLLOWER
I20260620 15:00:34.612232 1120 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c8bac6555849b480177f7d315fbe7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260620 15:00:34.612373 1120 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:34.612419 1120 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:34.612475 1120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:34.613847 1120 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c8bac6555849b480177f7d315fbe7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260620 15:00:34.613952 1120 leader_election.cc:302] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8c8bac6555849b480177f7d315fbe7a; no voters:
I20260620 15:00:34.614053 1124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:34.612220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43395 (local address 127.0.0.1:46107)
0620 15:00:34.612454 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:34.612466 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:34.612516 (+ 50us) server_negotiation.cc:407] Connection header received
0620 15:00:34.612669 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:34.612675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:34.612700 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:34.612816 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:34.613492 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:34.613495 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:34.613496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:34.613500 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:34.613541 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:34.613553 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:34.613633 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:34.613740 (+ 107us) server_negotiation.cc:299] Negotiation successful
0620 15:00:34.613804 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":142,"threads_started":1}
I20260620 15:00:34.614144 1120 leader_election.cc:288] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:34.614336 1126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:34.614414 1120 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:34.614526 1126 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [term 1 LEADER]: Becoming Leader. State: Replica: d8c8bac6555849b480177f7d315fbe7a, State: Running, Role: LEADER
I20260620 15:00:34.614642 1126 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c8bac6555849b480177f7d315fbe7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260620 15:00:34.615097 1127 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8c8bac6555849b480177f7d315fbe7a. Latest consensus state: current_term: 1 leader_uuid: "d8c8bac6555849b480177f7d315fbe7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c8bac6555849b480177f7d315fbe7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } } }
I20260620 15:00:34.615096 1125 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8c8bac6555849b480177f7d315fbe7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c8bac6555849b480177f7d315fbe7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } } }
I20260620 15:00:34.615209 1127 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:34.615216 1125 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:34.615252 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:34.615408 1134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:34.615969 1134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:34.621655 1134 catalog_manager.cc:1347] Generated new cluster ID: 006a6b5d776b445196033a709096e36e
I20260620 15:00:34.621745 1134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:34.626374 1124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:34.617418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60025 (local address 127.0.0.1:46107)
0620 15:00:34.617497 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:34.617501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:34.620711 (+ 3210us) server_negotiation.cc:407] Connection header received
0620 15:00:34.620838 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:34.620841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:34.620850 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:34.620916 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:34.625239 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:34.625242 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:34.625243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:34.625253 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:34.625571 (+ 318us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:34.625602 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:34.625998 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:34.626183 (+ 185us) server_negotiation.cc:299] Negotiation successful
0620 15:00:34.626213 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 15:00:34.629527 1134 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:34.629825 1134 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:34.641324 1134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8c8bac6555849b480177f7d315fbe7a: Generated new TSK 0
I20260620 15:00:34.641571 1134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:34.648566 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1052
2026-06-20T15:00:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:34 dist-test-slave-7v06 krb5kdc[1151](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:34 dist-test-slave-7v06 krb5kdc[1151](info): set up 2 sockets
Jun 20 15:00:34 dist-test-slave-7v06 krb5kdc[1151](info): commencing operation
krb5kdc: starting...
W20260620 15:00:35.784720 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:35 dist-test-slave-7v06 krb5kdc[1151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:35.955730 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38095
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:36.059021 1164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:36.059291 1164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:36.059319 1164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:36.060750 1164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:36.060823 1164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:36.060839 1164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:36.060853 1164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:36.060865 1164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:36.065084 1164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:36.065382 1164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:36.066392 1164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:36.073280 1169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:36.073302 1164 server_base.cc:1034] running on GCE node
W20260620 15:00:36.073287 1170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:36.073280 1172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:36.073937 1164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:36.074262 1164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:36.075512 1164 hybrid_clock.cc:648] HybridClock initialized: now 1781967636075489 us; error 55 us; skew 500 ppm
Jun 20 15:00:36 dist-test-slave-7v06 krb5kdc[1151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:36.079273 1164 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:36.079829 1164 webserver.cc:460] Webserver started at http://127.0.0.1:36557/ using document root <none> and password file <none>
I20260620 15:00:36.080119 1164 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:36.080204 1164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:36.080416 1164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:36.081701 1164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "239113ebe75c4987bd1d5b54ccc37828"
format_stamp: "Formatted at 2026-06-20 15:00:36 on dist-test-slave-7v06"
server_key: "05e12734caf7651bc532e21860bec0dc"
server_key_iv: "5c03ac1723de80476a42cb96ab426be5"
server_key_version: "encryptionkey@0"
I20260620 15:00:36.082149 1164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "239113ebe75c4987bd1d5b54ccc37828"
format_stamp: "Formatted at 2026-06-20 15:00:36 on dist-test-slave-7v06"
server_key: "05e12734caf7651bc532e21860bec0dc"
server_key_iv: "5c03ac1723de80476a42cb96ab426be5"
server_key_version: "encryptionkey@0"
I20260620 15:00:36.083793 1164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260620 15:00:36.085007 1179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:36.085347 1164 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 15:00:36.085476 1164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "239113ebe75c4987bd1d5b54ccc37828"
format_stamp: "Formatted at 2026-06-20 15:00:36 on dist-test-slave-7v06"
server_key: "05e12734caf7651bc532e21860bec0dc"
server_key_iv: "5c03ac1723de80476a42cb96ab426be5"
server_key_version: "encryptionkey@0"
I20260620 15:00:36.085585 1164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:36.104910 1164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:36.107828 1164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:36.107975 1164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:36.112619 1164 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38095
I20260620 15:00:36.112716 1231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38095 every 8 connection(s)
I20260620 15:00:36.113059 1164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:36.114542 1232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:36.116868 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1164
I20260620 15:00:36.117238 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:36.117683 12754 external_mini_cluster.cc:1428] Setting key 2fcb0d1ee0dd4f31ef18c8324a94eaf6
I20260620 15:00:36.118338 1232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828: Bootstrap starting.
I20260620 15:00:36.119328 1232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:36.119688 1232 log.cc:824] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:36.120730 1232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828: No bootstrap required, opened a new log
I20260620 15:00:36.124764 1232 raft_consensus.cc:348] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239113ebe75c4987bd1d5b54ccc37828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38095 } }
I20260620 15:00:36.125236 1232 raft_consensus.cc:374] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:36.125415 1232 raft_consensus.cc:729] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 239113ebe75c4987bd1d5b54ccc37828, State: Initialized, Role: FOLLOWER
I20260620 15:00:36.125772 1232 consensus_queue.cc:260] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239113ebe75c4987bd1d5b54ccc37828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38095 } }
I20260620 15:00:36.125962 1232 raft_consensus.cc:388] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:36.126051 1232 raft_consensus.cc:482] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:36.126322 1232 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:36.127705 1232 raft_consensus.cc:504] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239113ebe75c4987bd1d5b54ccc37828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38095 } }
I20260620 15:00:36.127923 1232 leader_election.cc:302] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 239113ebe75c4987bd1d5b54ccc37828; no voters:
I20260620 15:00:36.128186 1232 leader_election.cc:288] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:36.128218 1237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:36.128376 1237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [term 1 LEADER]: Becoming Leader. State: Replica: 239113ebe75c4987bd1d5b54ccc37828, State: Running, Role: LEADER
I20260620 15:00:36.128479 1237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239113ebe75c4987bd1d5b54ccc37828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38095 } }
I20260620 15:00:36.128561 1232 sys_catalog.cc:564] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:36.128916 1237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 239113ebe75c4987bd1d5b54ccc37828. Latest consensus state: current_term: 1 leader_uuid: "239113ebe75c4987bd1d5b54ccc37828" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239113ebe75c4987bd1d5b54ccc37828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38095 } } }
I20260620 15:00:36.129073 1237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:36.129292 1237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "239113ebe75c4987bd1d5b54ccc37828" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239113ebe75c4987bd1d5b54ccc37828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38095 } } }
I20260620 15:00:36.129443 1237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:36.129827 1245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 20 15:00:36 dist-test-slave-7v06 krb5kdc[1151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 15:00:36.130429 1245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:36.132500 1245 catalog_manager.cc:1347] Generated new cluster ID: c7d3ab022fd6475582314e619205a354
I20260620 15:00:36.132563 1245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:36.135365 1235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:36.119178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:36189 (local address 127.0.0.1:38095)
0620 15:00:36.119447 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:36.119459 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:36.119501 (+ 42us) server_negotiation.cc:407] Connection header received
0620 15:00:36.120147 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:36.120157 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:36.120452 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:36.120697 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:36.121722 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:36.123651 (+ 1929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:36.125433 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:36.126708 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:36.126876 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:36.130952 (+ 4076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:36.130958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:36.130958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:36.130973 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:36.133299 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:36.133885 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:36.133889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:36.133889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:36.134027 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:36.134304 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:36.134305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:36.134305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:36.134684 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:36.134870 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:36.134975 (+ 105us) server_negotiation.cc:299] Negotiation successful
0620 15:00:36.135095 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":124,"threads_started":1}
I20260620 15:00:36.136602 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:36.146727 1245 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:36.147572 1245 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:36.147765 1235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:36.138267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:37291 (local address 127.0.0.1:38095)
0620 15:00:36.138343 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:36.138345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:36.138471 (+ 126us) server_negotiation.cc:407] Connection header received
0620 15:00:36.138541 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:36.138542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:36.138554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:36.138620 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:36.139345 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:36.140160 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:36.141362 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:36.141728 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:36.141800 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:36.143918 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:36.143920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:36.143920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:36.143930 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:36.145960 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:36.146765 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:36.146767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:36.146768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:36.146837 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:36.147102 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:36.147103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:36.147103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:36.147254 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:36.147408 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:36.147587 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 15:00:36.147670 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260620 15:00:36.156965 1245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 239113ebe75c4987bd1d5b54ccc37828: Generated new TSK 0
I20260620 15:00:36.157282 1245 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:36.160372 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1164
W20260620 15:00:36.165252 1149 connection.cc:535] client connection to 127.0.0.1:38095 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38095): Connection reset by peer (error 104)
2026-06-20T15:00:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:36 dist-test-slave-7v06 krb5kdc[1263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:36 dist-test-slave-7v06 krb5kdc[1263](info): set up 2 sockets
Jun 20 15:00:36 dist-test-slave-7v06 krb5kdc[1263](info): commencing operation
krb5kdc: starting...
W20260620 15:00:37.316856 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:37 dist-test-slave-7v06 krb5kdc[1263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:37.460976 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34027
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:37.559890 1276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:37.560194 1276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:37.560226 1276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:37.561913 1276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:37.561993 1276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:37.562011 1276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:37.562026 1276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:37.562038 1276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:37.564059 1276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:37.564442 1276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:37.564698 1276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:37.571717 1284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:37.571686 1281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:37.571686 1282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:37.571686 1276 server_base.cc:1034] running on GCE node
I20260620 15:00:37.572528 1276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:37.572932 1276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:37.574131 1276 hybrid_clock.cc:648] HybridClock initialized: now 1781967637574072 us; error 71 us; skew 500 ppm
Jun 20 15:00:37 dist-test-slave-7v06 krb5kdc[1263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:37.583647 1276 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:37.584440 1276 webserver.cc:460] Webserver started at http://127.0.0.1:36175/ using document root <none> and password file <none>
I20260620 15:00:37.584733 1276 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:37.584818 1276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:37.584990 1276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:37.586257 1276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "76697149d3f244b69006cef03d0d5968"
format_stamp: "Formatted at 2026-06-20 15:00:37 on dist-test-slave-7v06"
server_key: "40734486f432f7fbeccae431e9d34594"
server_key_iv: "25b3c43ab8a92fef26936761d08ba779"
server_key_version: "encryptionkey@0"
I20260620 15:00:37.586712 1276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "76697149d3f244b69006cef03d0d5968"
format_stamp: "Formatted at 2026-06-20 15:00:37 on dist-test-slave-7v06"
server_key: "40734486f432f7fbeccae431e9d34594"
server_key_iv: "25b3c43ab8a92fef26936761d08ba779"
server_key_version: "encryptionkey@0"
I20260620 15:00:37.588701 1276 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260620 15:00:37.590180 1291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:37.590749 1276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:37.590914 1276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "76697149d3f244b69006cef03d0d5968"
format_stamp: "Formatted at 2026-06-20 15:00:37 on dist-test-slave-7v06"
server_key: "40734486f432f7fbeccae431e9d34594"
server_key_iv: "25b3c43ab8a92fef26936761d08ba779"
server_key_version: "encryptionkey@0"
I20260620 15:00:37.591019 1276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:37.615003 1276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:37.618897 1276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:37.619168 1276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:37.625643 1276 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34027
I20260620 15:00:37.625834 1343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34027 every 8 connection(s)
I20260620 15:00:37.626259 1276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:37.627604 1344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:37.627770 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1276
I20260620 15:00:37.628109 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:37.628400 12754 external_mini_cluster.cc:1428] Setting key 6a596eacde18ddd1c6e0ce1bc3f96fbe
I20260620 15:00:37.631938 1344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968: Bootstrap starting.
I20260620 15:00:37.632772 1344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:37.633318 1344 log.cc:824] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:37.634765 1344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968: No bootstrap required, opened a new log
I20260620 15:00:37.636700 1347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:37.629131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:57719 (local address 127.0.0.1:34027)
0620 15:00:37.629440 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:37.629449 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:37.629483 (+ 34us) server_negotiation.cc:407] Connection header received
0620 15:00:37.629991 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:37.629998 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:37.630055 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:37.630253 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:37.630503 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:37.631457 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:37.632709 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:37.633238 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:37.633385 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:37.634921 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:37.634929 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:37.634930 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:37.635188 (+ 258us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:37.635235 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:37.635253 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:37.635401 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:37.635779 (+ 378us) server_negotiation.cc:299] Negotiation successful
0620 15:00:37.635821 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":116,"threads_started":1}
I20260620 15:00:37.637072 1344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76697149d3f244b69006cef03d0d5968" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34027 } }
I20260620 15:00:37.637315 1344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:37.637346 1344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76697149d3f244b69006cef03d0d5968, State: Initialized, Role: FOLLOWER
I20260620 15:00:37.637521 1344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76697149d3f244b69006cef03d0d5968" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34027 } }
I20260620 15:00:37.637626 1344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:37.637665 1344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:37.637724 1344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:37.638070 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:37.638562 1344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76697149d3f244b69006cef03d0d5968" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34027 } }
I20260620 15:00:37.638715 1344 leader_election.cc:302] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76697149d3f244b69006cef03d0d5968; no voters:
I20260620 15:00:37.638960 1344 leader_election.cc:288] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:37.638996 1349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:37.639170 1349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [term 1 LEADER]: Becoming Leader. State: Replica: 76697149d3f244b69006cef03d0d5968, State: Running, Role: LEADER
I20260620 15:00:37.639331 1344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:37.639334 1349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76697149d3f244b69006cef03d0d5968" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34027 } }
I20260620 15:00:37.639883 1352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76697149d3f244b69006cef03d0d5968. Latest consensus state: current_term: 1 leader_uuid: "76697149d3f244b69006cef03d0d5968" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76697149d3f244b69006cef03d0d5968" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34027 } } }
I20260620 15:00:37.640187 1352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:37.640667 1351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76697149d3f244b69006cef03d0d5968" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76697149d3f244b69006cef03d0d5968" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34027 } } }
I20260620 15:00:37.640777 1351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:37.640930 1364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:37.641609 1364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:37.644018 1364 catalog_manager.cc:1347] Generated new cluster ID: d655f056b6b44c86a370c4adf104d21d
I20260620 15:00:37.644101 1364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:37.648424 1347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:37.639882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:36131 (local address 127.0.0.1:34027)
0620 15:00:37.640470 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:37.640473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:37.641715 (+ 1242us) server_negotiation.cc:407] Connection header received
0620 15:00:37.641851 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:37.641852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:37.641866 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:37.641903 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:37.642185 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:37.643145 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:37.646638 (+ 3493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:37.646931 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:37.647056 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:37.648024 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:37.648026 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:37.648027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:37.648034 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:37.648057 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:37.648062 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:37.648146 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:37.648251 (+ 105us) server_negotiation.cc:299] Negotiation successful
0620 15:00:37.648265 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552}
I20260620 15:00:37.652233 1364 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:37.652961 1364 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:37.657482 1364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76697149d3f244b69006cef03d0d5968: Generated new TSK 0
I20260620 15:00:37.658017 1364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:37.666961 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1276
W20260620 15:00:37.672278 1261 connection.cc:535] client connection to 127.0.0.1:34027 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34027): Connection reset by peer (error 104)
2026-06-20T15:00:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1506 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:37 dist-test-slave-7v06 krb5kdc[1376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:37 dist-test-slave-7v06 krb5kdc[1376](info): set up 2 sockets
Jun 20 15:00:37 dist-test-slave-7v06 krb5kdc[1376](info): commencing operation
krb5kdc: starting...
W20260620 15:00:38.816619 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:38 dist-test-slave-7v06 krb5kdc[1376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:38.974169 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41099
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:39.066968 1389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:39.067282 1389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:39.067327 1389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:39.068989 1389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:39.069131 1389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:39.069164 1389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:39.069195 1389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:39.069228 1389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:39.071120 1389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:39.071485 1389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:39.071751 1389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:39.078764 1397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:39.078764 1394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:39.078948 1395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:39.079423 1389 server_base.cc:1034] running on GCE node
I20260620 15:00:39.079689 1389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:39.080031 1389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:39.081229 1389 hybrid_clock.cc:648] HybridClock initialized: now 1781967639081200 us; error 53 us; skew 500 ppm
Jun 20 15:00:39 dist-test-slave-7v06 krb5kdc[1376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967639, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:39.084138 1389 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:39.084751 1389 webserver.cc:460] Webserver started at http://127.0.0.1:39763/ using document root <none> and password file <none>
I20260620 15:00:39.085029 1389 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:39.085104 1389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:39.085264 1389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:39.086501 1389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "6f225d3cf4994a7e94cf1a0897335d0a"
format_stamp: "Formatted at 2026-06-20 15:00:39 on dist-test-slave-7v06"
server_key: "d5b44b521d4ea631f49858737b661f14"
server_key_iv: "ed8ab72f1599df84efff65243766418b"
server_key_version: "encryptionkey@0"
I20260620 15:00:39.087154 1389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "6f225d3cf4994a7e94cf1a0897335d0a"
format_stamp: "Formatted at 2026-06-20 15:00:39 on dist-test-slave-7v06"
server_key: "d5b44b521d4ea631f49858737b661f14"
server_key_iv: "ed8ab72f1599df84efff65243766418b"
server_key_version: "encryptionkey@0"
I20260620 15:00:39.089710 1389 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260620 15:00:39.091924 1404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:39.092239 1389 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 15:00:39.092396 1389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "6f225d3cf4994a7e94cf1a0897335d0a"
format_stamp: "Formatted at 2026-06-20 15:00:39 on dist-test-slave-7v06"
server_key: "d5b44b521d4ea631f49858737b661f14"
server_key_iv: "ed8ab72f1599df84efff65243766418b"
server_key_version: "encryptionkey@0"
I20260620 15:00:39.092516 1389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:39.097906 1389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:39.102124 1389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:39.102335 1389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:39.109227 1389 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41099
I20260620 15:00:39.109529 1456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41099 every 8 connection(s)
I20260620 15:00:39.109709 1389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:39.110679 1457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:39.111451 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1389
I20260620 15:00:39.111608 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:39.111816 12754 external_mini_cluster.cc:1428] Setting key ff9e617837648c1bdeb27259514c353e
I20260620 15:00:39.114485 1457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a: Bootstrap starting.
I20260620 15:00:39.114733 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:39.112571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:36809 (local address 127.0.0.1:41099)
0620 15:00:39.112727 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:39.112736 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:39.112763 (+ 27us) server_negotiation.cc:407] Connection header received
0620 15:00:39.113216 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:39.113223 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:39.113251 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:39.113374 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:39.114162 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:39.114166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:39.114166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:39.114170 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:39.114215 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:39.114226 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:39.114292 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:39.114387 (+ 95us) server_negotiation.cc:299] Negotiation successful
0620 15:00:39.114461 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260620 15:00:39.115327 1457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:39.115665 1457 log.cc:824] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:39.115931 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:39.116542 1457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a: No bootstrap required, opened a new log
I20260620 15:00:39.118883 1457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41099 } }
I20260620 15:00:39.119061 1457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:39.119086 1457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f225d3cf4994a7e94cf1a0897335d0a, State: Initialized, Role: FOLLOWER
I20260620 15:00:39.119274 1457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41099 } }
I20260620 15:00:39.119400 1457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:39.119445 1457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:39.119513 1457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:39.119870 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:39.117746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:34197 (local address 127.0.0.1:41099)
0620 15:00:39.117797 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:39.117798 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:39.117931 (+ 133us) server_negotiation.cc:407] Connection header received
0620 15:00:39.118024 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:39.118025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:39.118031 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:39.118298 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:39.119568 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:39.119570 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:39.119571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:39.119577 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:39.119601 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:39.119606 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:39.119675 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:39.119767 (+ 92us) server_negotiation.cc:299] Negotiation successful
0620 15:00:39.119781 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 15:00:39.121042 1457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41099 } }
I20260620 15:00:39.121356 1457 leader_election.cc:302] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f225d3cf4994a7e94cf1a0897335d0a; no voters:
I20260620 15:00:39.121685 1457 leader_election.cc:288] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:39.121795 1467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:39.122087 1457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:39.122013 1467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [term 1 LEADER]: Becoming Leader. State: Replica: 6f225d3cf4994a7e94cf1a0897335d0a, State: Running, Role: LEADER
I20260620 15:00:39.122259 1467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41099 } }
I20260620 15:00:39.122756 1469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f225d3cf4994a7e94cf1a0897335d0a. Latest consensus state: current_term: 1 leader_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41099 } } }
I20260620 15:00:39.122735 1468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f225d3cf4994a7e94cf1a0897335d0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41099 } } }
I20260620 15:00:39.122884 1469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:39.122895 1468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:39.123131 1475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:39.123698 1475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:39.127978 1475 catalog_manager.cc:1347] Generated new cluster ID: 75893128bef64085a7eaf6eb6cd9b764
I20260620 15:00:39.128545 1475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:39.145262 1475 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:39.145521 1475 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:39.152119 1475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f225d3cf4994a7e94cf1a0897335d0a: Generated new TSK 0
I20260620 15:00:39.152472 1475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:39.157033 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1389
2026-06-20T15:00:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:39 dist-test-slave-7v06 krb5kdc[1488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:39 dist-test-slave-7v06 krb5kdc[1488](info): set up 2 sockets
Jun 20 15:00:39 dist-test-slave-7v06 krb5kdc[1488](info): commencing operation
krb5kdc: starting...
W20260620 15:00:40.301414 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:40 dist-test-slave-7v06 krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:40.453074 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37513
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:40.558153 1501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:40.558427 1501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:40.558454 1501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:40.559706 1501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:40.559756 1501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:40.559772 1501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:40.559784 1501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:40.559798 1501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:40.561455 1501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37513
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:40.561707 1501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:40.561908 1501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:40.568078 1507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:40.568078 1509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:40.568081 1506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:40.569226 1501 server_base.cc:1034] running on GCE node
I20260620 15:00:40.569553 1501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:40.570057 1501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:40.571306 1501 hybrid_clock.cc:648] HybridClock initialized: now 1781967640571276 us; error 43 us; skew 500 ppm
Jun 20 15:00:40 dist-test-slave-7v06 krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967640, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:40.574697 1501 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:40.575377 1501 webserver.cc:460] Webserver started at http://127.0.0.1:40537/ using document root <none> and password file <none>
I20260620 15:00:40.575685 1501 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:40.575738 1501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:40.575888 1501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:40.577219 1501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "7932e470265f43bcba46922b80c940aa"
format_stamp: "Formatted at 2026-06-20 15:00:40 on dist-test-slave-7v06"
server_key: "51c66b5d8c203d86da273f9ee990fc2a"
server_key_iv: "af7a44f099116d5a80fd1db47b410a8f"
server_key_version: "encryptionkey@0"
I20260620 15:00:40.577631 1501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "7932e470265f43bcba46922b80c940aa"
format_stamp: "Formatted at 2026-06-20 15:00:40 on dist-test-slave-7v06"
server_key: "51c66b5d8c203d86da273f9ee990fc2a"
server_key_iv: "af7a44f099116d5a80fd1db47b410a8f"
server_key_version: "encryptionkey@0"
I20260620 15:00:40.579367 1501 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:40.580448 1516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:40.580664 1501 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:40.580789 1501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "7932e470265f43bcba46922b80c940aa"
format_stamp: "Formatted at 2026-06-20 15:00:40 on dist-test-slave-7v06"
server_key: "51c66b5d8c203d86da273f9ee990fc2a"
server_key_iv: "af7a44f099116d5a80fd1db47b410a8f"
server_key_version: "encryptionkey@0"
I20260620 15:00:40.580890 1501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:40.598124 1501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:40.601347 1501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:40.601586 1501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:40.606482 1501 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37513
I20260620 15:00:40.606518 1568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37513 every 8 connection(s)
I20260620 15:00:40.606946 1501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:40.607913 1569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:40.610343 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1501
I20260620 15:00:40.610648 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:40.610900 12754 external_mini_cluster.cc:1428] Setting key 7bec4177a60a17acf00d15b4c3bad600
I20260620 15:00:40.610894 1569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa: Bootstrap starting.
I20260620 15:00:40.611732 1569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:40.612092 1569 log.cc:824] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:40.613436 1569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa: No bootstrap required, opened a new log
I20260620 15:00:40.616468 1569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7932e470265f43bcba46922b80c940aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37513 } }
I20260620 15:00:40.616703 1569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:40.616742 1569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7932e470265f43bcba46922b80c940aa, State: Initialized, Role: FOLLOWER
I20260620 15:00:40.616890 1569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7932e470265f43bcba46922b80c940aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37513 } }
I20260620 15:00:40.616993 1569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:40.617028 1569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:40.617069 1569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:40.617997 1569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7932e470265f43bcba46922b80c940aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37513 } }
I20260620 15:00:40.618152 1569 leader_election.cc:302] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7932e470265f43bcba46922b80c940aa; no voters:
I20260620 15:00:40.618371 1569 leader_election.cc:288] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:40.618464 1574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:40.618783 1574 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [term 1 LEADER]: Becoming Leader. State: Replica: 7932e470265f43bcba46922b80c940aa, State: Running, Role: LEADER
I20260620 15:00:40.618906 1574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7932e470265f43bcba46922b80c940aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37513 } }
I20260620 15:00:40.618939 1569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:40.619345 1574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7932e470265f43bcba46922b80c940aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7932e470265f43bcba46922b80c940aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37513 } } }
I20260620 15:00:40.619442 1574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:40.619573 1574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7932e470265f43bcba46922b80c940aa. Latest consensus state: current_term: 1 leader_uuid: "7932e470265f43bcba46922b80c940aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7932e470265f43bcba46922b80c940aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37513 } } }
I20260620 15:00:40.619628 1574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:40.619846 1579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 20 15:00:40 dist-test-slave-7v06 krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 15:00:40.621537 1579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:40.625234 1579 catalog_manager.cc:1347] Generated new cluster ID: f1cb7df07d1c4d0a912b433f22c62fda
I20260620 15:00:40.625344 1579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:40.627326 1572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:40.611933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:52481 (local address 127.0.0.1:37513)
0620 15:00:40.612441 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:40.612475 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:40.612518 (+ 43us) server_negotiation.cc:407] Connection header received
0620 15:00:40.613088 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:40.613096 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:40.613153 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:40.613291 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:40.614196 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:40.615417 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:40.616908 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:40.617579 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:40.617714 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:40.622416 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:40.622422 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:40.622422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:40.622445 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:40.625392 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:40.625937 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:40.625941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:40.625941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:40.626056 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:40.626316 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:40.626317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:40.626318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:40.626610 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:40.626799 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:40.626984 (+ 185us) server_negotiation.cc:299] Negotiation successful
0620 15:00:40.627111 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":290,"threads_started":1}
I20260620 15:00:40.628834 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:40.637645 1572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:40.630471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:44837 (local address 127.0.0.1:37513)
0620 15:00:40.630526 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:40.630528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:40.630616 (+ 88us) server_negotiation.cc:407] Connection header received
0620 15:00:40.630673 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:40.630674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:40.630687 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:40.630734 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:40.631359 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:40.631916 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:40.632843 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:40.633107 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:40.633196 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:40.634626 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:40.634627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:40.634628 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:40.634636 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:40.636225 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:40.636738 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:40.636740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:40.636740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:40.636811 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:40.637056 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:40.637057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:40.637058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:40.637186 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:40.637317 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:40.637444 (+ 127us) server_negotiation.cc:299] Negotiation successful
0620 15:00:40.637513 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 15:00:40.638604 1579 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:40.639496 1579 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:40.644860 1579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7932e470265f43bcba46922b80c940aa: Generated new TSK 0
I20260620 15:00:40.645185 1579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:40.648689 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1501
W20260620 15:00:40.654139 1486 connection.cc:535] client connection to 127.0.0.1:37513 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37513): Connection reset by peer (error 104)
2026-06-20T15:00:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:40 dist-test-slave-7v06 krb5kdc[1600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:40 dist-test-slave-7v06 krb5kdc[1600](info): set up 2 sockets
Jun 20 15:00:40 dist-test-slave-7v06 krb5kdc[1600](info): commencing operation
krb5kdc: starting...
W20260620 15:00:41.780759 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:41 dist-test-slave-7v06 krb5kdc[1600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:41.929944 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42973
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:42.024240 1613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:42.024597 1613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:42.024629 1613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:42.026083 1613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:42.026140 1613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:42.026155 1613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:42.026170 1613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:42.026182 1613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:42.027863 1613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42973
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:42.028191 1613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:42.028789 1613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:42.035012 1621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:42.035000 1618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:42.035231 1613 server_base.cc:1034] running on GCE node
W20260620 15:00:42.034994 1619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:42.035573 1613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:42.036057 1613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:42.037295 1613 hybrid_clock.cc:648] HybridClock initialized: now 1781967642037306 us; error 61 us; skew 500 ppm
Jun 20 15:00:42 dist-test-slave-7v06 krb5kdc[1600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967642, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:42.041970 1613 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:42.042867 1613 webserver.cc:460] Webserver started at http://127.0.0.1:34233/ using document root <none> and password file <none>
I20260620 15:00:42.043154 1613 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:42.043232 1613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:42.043383 1613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:42.044629 1613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "d0b1109354984fceb1506490ce1d3331"
format_stamp: "Formatted at 2026-06-20 15:00:42 on dist-test-slave-7v06"
server_key: "60f85ad64938b9dde44100ca9402a401"
server_key_iv: "d6f85280b9430ab24eeb68fdfca620ff"
server_key_version: "encryptionkey@0"
I20260620 15:00:42.045006 1613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "d0b1109354984fceb1506490ce1d3331"
format_stamp: "Formatted at 2026-06-20 15:00:42 on dist-test-slave-7v06"
server_key: "60f85ad64938b9dde44100ca9402a401"
server_key_iv: "d6f85280b9430ab24eeb68fdfca620ff"
server_key_version: "encryptionkey@0"
I20260620 15:00:42.046512 1613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:42.047634 1628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:42.047930 1613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:42.048084 1613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "d0b1109354984fceb1506490ce1d3331"
format_stamp: "Formatted at 2026-06-20 15:00:42 on dist-test-slave-7v06"
server_key: "60f85ad64938b9dde44100ca9402a401"
server_key_iv: "d6f85280b9430ab24eeb68fdfca620ff"
server_key_version: "encryptionkey@0"
I20260620 15:00:42.048175 1613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:42.062515 1613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:42.065830 1613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:42.066036 1613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:42.070663 1613 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42973
I20260620 15:00:42.070750 1680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42973 every 8 connection(s)
I20260620 15:00:42.071151 1613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:42.072144 1681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:42.074708 1681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331: Bootstrap starting.
I20260620 15:00:42.075407 1681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:42.075742 1681 log.cc:824] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:42.076740 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1613
I20260620 15:00:42.076779 1681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331: No bootstrap required, opened a new log
I20260620 15:00:42.077065 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:42.077327 12754 external_mini_cluster.cc:1428] Setting key 4ad270fc631293f7ce6b2ae0be288e2b
I20260620 15:00:42.079644 1681 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b1109354984fceb1506490ce1d3331" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260620 15:00:42.080003 1681 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:42.080060 1681 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0b1109354984fceb1506490ce1d3331, State: Initialized, Role: FOLLOWER
I20260620 15:00:42.080276 1681 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b1109354984fceb1506490ce1d3331" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260620 15:00:42.080421 1681 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:42.080473 1681 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:42.080531 1681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:42.081724 1681 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b1109354984fceb1506490ce1d3331" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260620 15:00:42.081874 1681 leader_election.cc:302] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0b1109354984fceb1506490ce1d3331; no voters:
I20260620 15:00:42.082105 1681 leader_election.cc:288] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:42.082172 1686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:42.082504 1681 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:42.082623 1686 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [term 1 LEADER]: Becoming Leader. State: Replica: d0b1109354984fceb1506490ce1d3331, State: Running, Role: LEADER
I20260620 15:00:42.082975 1686 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b1109354984fceb1506490ce1d3331" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260620 15:00:42.083647 1686 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0b1109354984fceb1506490ce1d3331. Latest consensus state: current_term: 1 leader_uuid: "d0b1109354984fceb1506490ce1d3331" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b1109354984fceb1506490ce1d3331" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } } }
I20260620 15:00:42.083842 1686 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:42.084527 1696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:42.084738 1688 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0b1109354984fceb1506490ce1d3331" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b1109354984fceb1506490ce1d3331" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } } }
I20260620 15:00:42.085229 1696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:42.085548 1688 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:42.086866 1685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:42.077974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:49937 (local address 127.0.0.1:42973)
0620 15:00:42.078235 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:42.078246 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:42.078288 (+ 42us) server_negotiation.cc:407] Connection header received
0620 15:00:42.078973 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:42.078983 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:42.079057 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:42.079246 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:42.079641 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:42.081678 (+ 2037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:42.083443 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:42.084658 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:42.084829 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:42.085832 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:42.085838 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:42.085838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:42.086120 (+ 282us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:42.086168 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:42.086187 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:42.086286 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:42.086585 (+ 299us) server_negotiation.cc:299] Negotiation successful
0620 15:00:42.086619 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":112,"threads_started":1}
I20260620 15:00:42.087879 1696 catalog_manager.cc:1347] Generated new cluster ID: e2b9e2ad6be147b7bb14824d81bd0c94
I20260620 15:00:42.087988 1696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:42.088434 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:42.099864 1685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:42.090327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:36623 (local address 127.0.0.1:42973)
0620 15:00:42.090385 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:42.090387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:42.096683 (+ 6296us) server_negotiation.cc:407] Connection header received
0620 15:00:42.096767 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:42.096769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:42.096784 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:42.096883 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:42.097057 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:42.097594 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:42.098416 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:42.098675 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:42.098767 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:42.099580 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:42.099582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:42.099582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:42.099588 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:42.099604 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:42.099608 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:42.099687 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:42.099751 (+ 64us) server_negotiation.cc:299] Negotiation successful
0620 15:00:42.099763 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 15:00:42.104544 1696 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:42.105382 1696 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:42.113492 1696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0b1109354984fceb1506490ce1d3331: Generated new TSK 0
I20260620 15:00:42.113799 1696 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:42.117377 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1613
W20260620 15:00:42.122084 1598 connection.cc:535] client connection to 127.0.0.1:42973 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42973): Connection reset by peer (error 104)
2026-06-20T15:00:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1467 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:42 dist-test-slave-7v06 krb5kdc[1712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:42 dist-test-slave-7v06 krb5kdc[1712](info): set up 2 sockets
Jun 20 15:00:42 dist-test-slave-7v06 krb5kdc[1712](info): commencing operation
krb5kdc: starting...
W20260620 15:00:43.220628 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:43 dist-test-slave-7v06 krb5kdc[1712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 15:00:43.363950 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45623
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:43.457587 1725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:43.457850 1725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:43.457881 1725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:43.459261 1725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:43.459334 1725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:43.459350 1725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:43.459365 1725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:43.459378 1725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:43.461308 1725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45623
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:43.461604 1725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:43.461819 1725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:43.468082 1730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:43.468075 1733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:43.468451 1725 server_base.cc:1034] running on GCE node
W20260620 15:00:43.468473 1731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:43.469033 1725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:43.469538 1725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:43.470767 1725 hybrid_clock.cc:648] HybridClock initialized: now 1781967643470709 us; error 75 us; skew 500 ppm
Jun 20 15:00:43 dist-test-slave-7v06 krb5kdc[1712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967643, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:43.479341 1725 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 15:00:43.480273 1725 webserver.cc:460] Webserver started at http://127.0.0.1:37739/ using document root <none> and password file <none>
I20260620 15:00:43.480798 1725 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:43.480868 1725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:43.481042 1725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:43.482617 1725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "930a6239b12942d5b3608feb4d6841cc"
format_stamp: "Formatted at 2026-06-20 15:00:43 on dist-test-slave-7v06"
server_key: "1a8a160934fa7c86b882de3b2dbef9ca"
server_key_iv: "b095832b3926f34ca625e42468964c66"
server_key_version: "encryptionkey@0"
I20260620 15:00:43.483090 1725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "930a6239b12942d5b3608feb4d6841cc"
format_stamp: "Formatted at 2026-06-20 15:00:43 on dist-test-slave-7v06"
server_key: "1a8a160934fa7c86b882de3b2dbef9ca"
server_key_iv: "b095832b3926f34ca625e42468964c66"
server_key_version: "encryptionkey@0"
I20260620 15:00:43.484822 1725 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260620 15:00:43.485930 1740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:43.486373 1725 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:43.486604 1725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "930a6239b12942d5b3608feb4d6841cc"
format_stamp: "Formatted at 2026-06-20 15:00:43 on dist-test-slave-7v06"
server_key: "1a8a160934fa7c86b882de3b2dbef9ca"
server_key_iv: "b095832b3926f34ca625e42468964c66"
server_key_version: "encryptionkey@0"
I20260620 15:00:43.486755 1725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:43.491040 1725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:43.494807 1725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:43.495060 1725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:43.501542 1725 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45623
I20260620 15:00:43.501569 1792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45623 every 8 connection(s)
I20260620 15:00:43.502036 1725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:43.503291 1793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:43.507591 1793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc: Bootstrap starting.
I20260620 15:00:43.508486 1793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:43.508843 1793 log.cc:824] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:43.509856 1793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc: No bootstrap required, opened a new log
I20260620 15:00:43.510414 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1725
I20260620 15:00:43.510567 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:43.510785 12754 external_mini_cluster.cc:1428] Setting key 30a03c231ed056ac92a8f4110794d3e0
I20260620 15:00:43.512261 1793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930a6239b12942d5b3608feb4d6841cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260620 15:00:43.512531 1793 raft_consensus.cc:374] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:43.512619 1793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930a6239b12942d5b3608feb4d6841cc, State: Initialized, Role: FOLLOWER
I20260620 15:00:43.512811 1793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930a6239b12942d5b3608feb4d6841cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260620 15:00:43.512921 1793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:43.513001 1793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:43.513062 1793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:43.514276 1797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:43.511425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:39731 (local address 127.0.0.1:45623)
0620 15:00:43.511692 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:43.511704 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:43.511785 (+ 81us) server_negotiation.cc:407] Connection header received
0620 15:00:43.512454 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:43.512471 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:43.512518 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:43.512715 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:43.513700 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:43.513704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:43.513704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:43.513709 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:43.513764 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:43.513777 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:43.513847 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:43.513942 (+ 95us) server_negotiation.cc:299] Negotiation successful
0620 15:00:43.514018 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":99,"threads_started":1}
I20260620 15:00:43.514312 1793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930a6239b12942d5b3608feb4d6841cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260620 15:00:43.514444 1793 leader_election.cc:302] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 930a6239b12942d5b3608feb4d6841cc; no voters:
I20260620 15:00:43.514698 1793 leader_election.cc:288] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:43.514740 1798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:43.514950 1798 raft_consensus.cc:686] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [term 1 LEADER]: Becoming Leader. State: Replica: 930a6239b12942d5b3608feb4d6841cc, State: Running, Role: LEADER
I20260620 15:00:43.515020 1793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:43.515108 1798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930a6239b12942d5b3608feb4d6841cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260620 15:00:43.515509 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:43.515605 1798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 930a6239b12942d5b3608feb4d6841cc. Latest consensus state: current_term: 1 leader_uuid: "930a6239b12942d5b3608feb4d6841cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930a6239b12942d5b3608feb4d6841cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } } }
I20260620 15:00:43.515686 1798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:43.517133 1800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "930a6239b12942d5b3608feb4d6841cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930a6239b12942d5b3608feb4d6841cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } } }
I20260620 15:00:43.517253 1800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc [sys.catalog]: This master's current role is: LEADER
W20260620 15:00:43.517225 1814 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:43.517457 1814 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:43.517529 1806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:43.517751 1806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:43.520188 1806 catalog_manager.cc:1347] Generated new cluster ID: 92322dcbdb72439e9366328fec25f891
I20260620 15:00:43.520264 1806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:43.520491 1797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:43.517400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:39665 (local address 127.0.0.1:45623)
0620 15:00:43.517437 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:43.517440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:43.519196 (+ 1756us) server_negotiation.cc:407] Connection header received
0620 15:00:43.519334 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:43.519336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:43.519344 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:43.519427 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:43.520200 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:43.520201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:43.520201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:43.520207 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:43.520224 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:43.520228 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:43.520279 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:43.520400 (+ 121us) server_negotiation.cc:299] Negotiation successful
0620 15:00:43.520418 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 15:00:43.537650 1806 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:43.537882 1806 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:43.551381 1806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 930a6239b12942d5b3608feb4d6841cc: Generated new TSK 0
I20260620 15:00:43.551798 1806 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:43.554309 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1725
2026-06-20T15:00:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1438 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:43 dist-test-slave-7v06 krb5kdc[1824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:43 dist-test-slave-7v06 krb5kdc[1824](info): set up 2 sockets
Jun 20 15:00:43 dist-test-slave-7v06 krb5kdc[1824](info): commencing operation
krb5kdc: starting...
W20260620 15:00:44.741377 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:44 dist-test-slave-7v06 krb5kdc[1824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:44.876215 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43921
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:34001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:43921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:44.974164 1837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:44.974431 1837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:44.974460 1837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:44.975864 1837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:44.975939 1837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:44.975955 1837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:44.975968 1837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:44.975981 1837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:44.978799 1837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:34001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:43921
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:43921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:44.979175 1837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:44.979492 1837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:44.987489 1845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:44.987576 1842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:44.987581 1837 server_base.cc:1034] running on GCE node
W20260620 15:00:44.987485 1843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:44.988026 1837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:44.988415 1837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:44.989653 1837 hybrid_clock.cc:648] HybridClock initialized: now 1781967644989610 us; error 58 us; skew 500 ppm
Jun 20 15:00:44 dist-test-slave-7v06 krb5kdc[1824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967644, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:44.996122 1837 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:44.996778 1837 webserver.cc:460] Webserver started at http://127.12.116.190:41993/ using document root <none> and password file <none>
I20260620 15:00:44.997051 1837 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:44.997100 1837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:44.997248 1837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:44.998489 1837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "d2c1e8bef10a48c1b45d88b6178e5e32"
format_stamp: "Formatted at 2026-06-20 15:00:44 on dist-test-slave-7v06"
server_key: "9db33e0189d43fdb687f4c45fa2ec2d5"
server_key_iv: "4231ef3d2c7fcc4c9a50363ff8dcccea"
server_key_version: "encryptionkey@0"
I20260620 15:00:44.999202 1837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "d2c1e8bef10a48c1b45d88b6178e5e32"
format_stamp: "Formatted at 2026-06-20 15:00:44 on dist-test-slave-7v06"
server_key: "9db33e0189d43fdb687f4c45fa2ec2d5"
server_key_iv: "4231ef3d2c7fcc4c9a50363ff8dcccea"
server_key_version: "encryptionkey@0"
I20260620 15:00:45.001550 1837 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260620 15:00:45.002501 1852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:45.002904 1837 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:45.003015 1837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "d2c1e8bef10a48c1b45d88b6178e5e32"
format_stamp: "Formatted at 2026-06-20 15:00:44 on dist-test-slave-7v06"
server_key: "9db33e0189d43fdb687f4c45fa2ec2d5"
server_key_iv: "4231ef3d2c7fcc4c9a50363ff8dcccea"
server_key_version: "encryptionkey@0"
I20260620 15:00:45.003106 1837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:45.022774 1837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:45.025370 1837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:45.025560 1837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:45.029752 1837 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:43921
I20260620 15:00:45.029793 1904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:43921 every 8 connection(s)
I20260620 15:00:45.030191 1837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:45.031250 1905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:45.033164 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1837
I20260620 15:00:45.033306 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:45.033519 12754 external_mini_cluster.cc:1428] Setting key b799142ba3fe15f14255666fd004e8ff
I20260620 15:00:45.034474 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32: Bootstrap starting.
I20260620 15:00:45.035182 1905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:45.035568 1905 log.cc:824] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:45.036536 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32: No bootstrap required, opened a new log
I20260620 15:00:45.040282 1905 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43921 } }
I20260620 15:00:45.040915 1905 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:45.041074 1905 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c1e8bef10a48c1b45d88b6178e5e32, State: Initialized, Role: FOLLOWER
I20260620 15:00:45.041332 1905 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43921 } }
Jun 20 15:00:45 dist-test-slave-7v06 krb5kdc[1824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:45.041656 1905 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:45.041905 1905 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:45.042008 1905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:45.042768 1905 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43921 } }
I20260620 15:00:45.042949 1905 leader_election.cc:302] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2c1e8bef10a48c1b45d88b6178e5e32; no voters:
I20260620 15:00:45.043167 1905 leader_election.cc:288] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:45.043195 1910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:45.043330 1910 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [term 1 LEADER]: Becoming Leader. State: Replica: d2c1e8bef10a48c1b45d88b6178e5e32, State: Running, Role: LEADER
I20260620 15:00:45.043782 1905 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:45.043488 1910 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43921 } }
I20260620 15:00:45.045683 1912 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c1e8bef10a48c1b45d88b6178e5e32. Latest consensus state: current_term: 1 leader_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43921 } } }
I20260620 15:00:45.045845 1911 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c1e8bef10a48c1b45d88b6178e5e32" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 43921 } } }
I20260620 15:00:45.045958 1912 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:45.045972 1911 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32 [sys.catalog]: This master's current role is: LEADER
W20260620 15:00:45.046468 1925 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:45.046546 1925 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:45.046608 1926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:45.046806 1926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:45.047672 1908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:45.034172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55645 (local address 127.12.116.190:43921)
0620 15:00:45.034369 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:45.034378 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:45.034409 (+ 31us) server_negotiation.cc:407] Connection header received
0620 15:00:45.034912 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:45.034920 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:45.034975 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:45.035117 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:45.036031 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:45.037109 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:45.037954 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:45.038425 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:45.038569 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:45.042349 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:45.042354 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:45.042355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:45.042369 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:45.045272 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:45.045863 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:45.045866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:45.045867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:45.045986 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:45.046272 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:45.046273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:45.046274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:45.046536 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:45.047158 (+ 622us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:45.047236 (+ 78us) server_negotiation.cc:299] Negotiation successful
0620 15:00:45.047412 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260620 15:00:45.048758 1926 catalog_manager.cc:1347] Generated new cluster ID: 0afc0b91eb744a3eacc4b45aea14b04f
I20260620 15:00:45.048815 1926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:45.048957 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:45.055785 1926 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:45.056658 1926 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:45.068428 1908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:45.052780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47759 (local address 127.12.116.190:43921)
0620 15:00:45.052825 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:45.052828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:45.060665 (+ 7837us) server_negotiation.cc:407] Connection header received
0620 15:00:45.060784 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:45.060786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:45.060807 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:45.060884 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:45.061643 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:45.062259 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:45.063043 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:45.063297 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:45.063383 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:45.065132 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:45.065134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:45.065135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:45.065143 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:45.066667 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:45.067096 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:45.067097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:45.067098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:45.067164 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:45.067766 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:45.067767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:45.067768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:45.067909 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:45.068065 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:45.068208 (+ 143us) server_negotiation.cc:299] Negotiation successful
0620 15:00:45.068281 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 15:00:45.071622 1926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2c1e8bef10a48c1b45d88b6178e5e32: Generated new TSK 0
I20260620 15:00:45.071866 1926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:45.075213 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1837
W20260620 15:00:45.082442 1822 connection.cc:535] client connection to 127.12.116.190:43921 recv error: Network error: failed to read from TLS socket (remote: 127.12.116.190:43921): Connection reset by peer (error 104)
2026-06-20T15:00:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1523 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:45 dist-test-slave-7v06 krb5kdc[1936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:45 dist-test-slave-7v06 krb5kdc[1936](info): set up 2 sockets
Jun 20 15:00:45 dist-test-slave-7v06 krb5kdc[1936](info): commencing operation
krb5kdc: starting...
W20260620 15:00:46.192787 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:46 dist-test-slave-7v06 krb5kdc[1936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:46.333467 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34685
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:40195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:34685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:46.443890 1949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:46.444228 1949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:46.444278 1949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:46.445751 1949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:46.445845 1949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:46.445870 1949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:46.445891 1949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:46.445920 1949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:46.448104 1949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:40195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:34685
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:46.448527 1949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:46.448812 1949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:46.454833 1957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:46.455309 1955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:46.455451 1949 server_base.cc:1034] running on GCE node
W20260620 15:00:46.455701 1954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:46.456148 1949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:46.456591 1949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:46.457813 1949 hybrid_clock.cc:648] HybridClock initialized: now 1781967646457786 us; error 43 us; skew 500 ppm
Jun 20 15:00:46 dist-test-slave-7v06 krb5kdc[1936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967646, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:46.462438 1949 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:46.463220 1949 webserver.cc:460] Webserver started at http://127.12.116.190:43471/ using document root <none> and password file <none>
I20260620 15:00:46.463539 1949 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:46.463622 1949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:46.463786 1949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:46.465339 1949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "923b018f1e3841ac9febcef04998a4fb"
format_stamp: "Formatted at 2026-06-20 15:00:46 on dist-test-slave-7v06"
server_key: "23d337cb1a36234bdc750ae934b036f9"
server_key_iv: "24ff4985a196a7a59046e880e67b7c6f"
server_key_version: "encryptionkey@0"
I20260620 15:00:46.465811 1949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "923b018f1e3841ac9febcef04998a4fb"
format_stamp: "Formatted at 2026-06-20 15:00:46 on dist-test-slave-7v06"
server_key: "23d337cb1a36234bdc750ae934b036f9"
server_key_iv: "24ff4985a196a7a59046e880e67b7c6f"
server_key_version: "encryptionkey@0"
I20260620 15:00:46.468166 1949 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 15:00:46.469485 1964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:46.469986 1949 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:46.470099 1949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "923b018f1e3841ac9febcef04998a4fb"
format_stamp: "Formatted at 2026-06-20 15:00:46 on dist-test-slave-7v06"
server_key: "23d337cb1a36234bdc750ae934b036f9"
server_key_iv: "24ff4985a196a7a59046e880e67b7c6f"
server_key_version: "encryptionkey@0"
I20260620 15:00:46.470196 1949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:46.515789 1949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:46.518457 1949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:46.518635 1949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:46.523388 1949 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:34685
I20260620 15:00:46.523419 2016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:34685 every 8 connection(s)
I20260620 15:00:46.523881 1949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:46.524946 2017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:46.527326 2017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb: Bootstrap starting.
I20260620 15:00:46.527958 2017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:46.528261 2017 log.cc:824] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:46.529171 2017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb: No bootstrap required, opened a new log
I20260620 15:00:46.530884 2017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923b018f1e3841ac9febcef04998a4fb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34685 } }
I20260620 15:00:46.531075 2017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:46.531102 2017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 923b018f1e3841ac9febcef04998a4fb, State: Initialized, Role: FOLLOWER
I20260620 15:00:46.531258 2017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923b018f1e3841ac9febcef04998a4fb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34685 } }
I20260620 15:00:46.531286 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 1949
I20260620 15:00:46.531342 2017 raft_consensus.cc:388] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:46.531397 2017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:46.531412 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:46.531453 2017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:46.531625 12754 external_mini_cluster.cc:1428] Setting key 09f91de1301c0961f65f20c31e9a1cd3
I20260620 15:00:46.533444 2017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923b018f1e3841ac9febcef04998a4fb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34685 } }
I20260620 15:00:46.533681 2017 leader_election.cc:302] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 923b018f1e3841ac9febcef04998a4fb; no voters:
I20260620 15:00:46.533985 2017 leader_election.cc:288] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:46.534035 2022 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:46.534212 2022 raft_consensus.cc:686] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [term 1 LEADER]: Becoming Leader. State: Replica: 923b018f1e3841ac9febcef04998a4fb, State: Running, Role: LEADER
I20260620 15:00:46.534425 2022 consensus_queue.cc:237] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923b018f1e3841ac9febcef04998a4fb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34685 } }
I20260620 15:00:46.534411 2017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:46.534981 2023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "923b018f1e3841ac9febcef04998a4fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923b018f1e3841ac9febcef04998a4fb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34685 } } }
I20260620 15:00:46.535172 2023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:46.535418 2024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 923b018f1e3841ac9febcef04998a4fb. Latest consensus state: current_term: 1 leader_uuid: "923b018f1e3841ac9febcef04998a4fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923b018f1e3841ac9febcef04998a4fb" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34685 } } }
I20260620 15:00:46.535713 2024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:46.536561 2026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:46.537130 2026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:46.538970 2021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:46.532248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39945 (local address 127.12.116.190:34685)
0620 15:00:46.532482 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:46.532491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:46.532520 (+ 29us) server_negotiation.cc:407] Connection header received
0620 15:00:46.532657 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:46.532663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:46.532714 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:46.532869 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:46.533411 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:46.534726 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:46.536397 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:46.537113 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:46.537251 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:46.538238 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:46.538242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:46.538242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:46.538415 (+ 173us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:46.538476 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:46.538492 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:46.538586 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:46.538709 (+ 123us) server_negotiation.cc:299] Negotiation successful
0620 15:00:46.538745 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":143,"threads_started":1}
I20260620 15:00:46.539351 2026 catalog_manager.cc:1347] Generated new cluster ID: 23059d75995c4ba1ac2fd28b001ed575
I20260620 15:00:46.539402 2026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:46.540129 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:46.545629 2021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:46.541618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44255 (local address 127.12.116.190:34685)
0620 15:00:46.541655 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:46.541657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:46.541813 (+ 156us) server_negotiation.cc:407] Connection header received
0620 15:00:46.541882 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:46.541882 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:46.541893 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:46.541955 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:46.542118 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:46.542860 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:46.544039 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:46.544419 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:46.544488 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:46.545346 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:46.545347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:46.545347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:46.545354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:46.545375 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:46.545381 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:46.545434 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:46.545522 (+ 88us) server_negotiation.cc:299] Negotiation successful
0620 15:00:46.545536 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 15:00:46.556242 2026 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:46.556989 2026 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:46.571558 2026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 923b018f1e3841ac9febcef04998a4fb: Generated new TSK 0
I20260620 15:00:46.571918 2026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:46.579330 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 1949
W20260620 15:00:46.585035 1934 connection.cc:535] client connection to 127.12.116.190:34685 recv error: Network error: failed to read from TLS socket (remote: 127.12.116.190:34685): Connection reset by peer (error 104)
2026-06-20T15:00:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:46 dist-test-slave-7v06 krb5kdc[2048](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:46 dist-test-slave-7v06 krb5kdc[2048](info): set up 2 sockets
Jun 20 15:00:46 dist-test-slave-7v06 krb5kdc[2048](info): commencing operation
krb5kdc: starting...
W20260620 15:00:47.657011 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:47 dist-test-slave-7v06 krb5kdc[2048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:47.805080 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38639
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:34531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:38639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:47.898698 2061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:47.898952 2061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:47.898980 2061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:47.900496 2061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:47.900565 2061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:47.900583 2061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:47.900596 2061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:47.900609 2061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:47.902477 2061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:34531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:38639
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:47.902812 2061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:47.903105 2061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:47.908753 2066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:47.908753 2067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:47.908753 2069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:47.908986 2061 server_base.cc:1034] running on GCE node
I20260620 15:00:47.909364 2061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:47.909932 2061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:47.911171 2061 hybrid_clock.cc:648] HybridClock initialized: now 1781967647911126 us; error 62 us; skew 500 ppm
Jun 20 15:00:47 dist-test-slave-7v06 krb5kdc[2048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967647, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:47.914165 2061 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:47.914842 2061 webserver.cc:460] Webserver started at http://127.12.116.190:37161/ using document root <none> and password file <none>
I20260620 15:00:47.915098 2061 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:47.915149 2061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:47.915297 2061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:47.916569 2061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "836a86528e9f438184257661265d9531"
format_stamp: "Formatted at 2026-06-20 15:00:47 on dist-test-slave-7v06"
server_key: "de68da0bc4b63b18ecd539713e7ca6f0"
server_key_iv: "d18b62741acbba49a03fbf9238af871b"
server_key_version: "encryptionkey@0"
I20260620 15:00:47.916970 2061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "836a86528e9f438184257661265d9531"
format_stamp: "Formatted at 2026-06-20 15:00:47 on dist-test-slave-7v06"
server_key: "de68da0bc4b63b18ecd539713e7ca6f0"
server_key_iv: "d18b62741acbba49a03fbf9238af871b"
server_key_version: "encryptionkey@0"
I20260620 15:00:47.919689 2061 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260620 15:00:47.920928 2076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:47.921262 2061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:47.921379 2061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "836a86528e9f438184257661265d9531"
format_stamp: "Formatted at 2026-06-20 15:00:47 on dist-test-slave-7v06"
server_key: "de68da0bc4b63b18ecd539713e7ca6f0"
server_key_iv: "d18b62741acbba49a03fbf9238af871b"
server_key_version: "encryptionkey@0"
I20260620 15:00:47.921967 2061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:47.926299 2061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:47.930450 2061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:47.930742 2061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:47.935721 2061 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:38639
I20260620 15:00:47.935814 2128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:38639 every 8 connection(s)
I20260620 15:00:47.936190 2061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:47.937415 2129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:47.940690 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531: Bootstrap starting.
I20260620 15:00:47.941805 2129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:47.942217 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2061
I20260620 15:00:47.942226 2129 log.cc:824] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:47.942356 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:47.942595 12754 external_mini_cluster.cc:1428] Setting key f442f021ee9c1132c6ff135b14568cda
I20260620 15:00:47.943318 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531: No bootstrap required, opened a new log
I20260620 15:00:47.945962 2133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:47.943209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60633 (local address 127.12.116.190:38639)
0620 15:00:47.943436 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:47.943447 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:47.943485 (+ 38us) server_negotiation.cc:407] Connection header received
0620 15:00:47.944154 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:47.944163 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:47.944197 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:47.944455 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:47.945469 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:47.945473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:47.945473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:47.945478 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:47.945537 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:47.945549 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:47.945665 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:47.945714 (+ 49us) server_negotiation.cc:299] Negotiation successful
0620 15:00:47.945766 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":86,"threads_started":1}
I20260620 15:00:47.947436 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:47.947742 2129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836a86528e9f438184257661265d9531" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38639 } }
I20260620 15:00:47.947945 2129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:47.948000 2129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a86528e9f438184257661265d9531, State: Initialized, Role: FOLLOWER
I20260620 15:00:47.948154 2129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836a86528e9f438184257661265d9531" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38639 } }
I20260620 15:00:47.948262 2129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:47.948310 2129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:47.948395 2129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:47.949339 2129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836a86528e9f438184257661265d9531" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38639 } }
I20260620 15:00:47.949491 2129 leader_election.cc:302] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 836a86528e9f438184257661265d9531; no voters:
I20260620 15:00:47.949703 2129 leader_election.cc:288] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:47.949723 2139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:47.950045 2129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:47.950654 2133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:47.949199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54507 (local address 127.12.116.190:38639)
0620 15:00:47.949250 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:47.949252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:47.949385 (+ 133us) server_negotiation.cc:407] Connection header received
0620 15:00:47.949467 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:47.949467 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:47.949473 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:47.949529 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:47.950354 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:47.950355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:47.950355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:47.950360 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:47.950378 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:47.950382 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:47.950433 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:47.950545 (+ 112us) server_negotiation.cc:299] Negotiation successful
0620 15:00:47.950560 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 15:00:47.951062 2139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [term 1 LEADER]: Becoming Leader. State: Replica: 836a86528e9f438184257661265d9531, State: Running, Role: LEADER
I20260620 15:00:47.951205 2139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836a86528e9f438184257661265d9531" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38639 } }
I20260620 15:00:47.951581 2141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 836a86528e9f438184257661265d9531. Latest consensus state: current_term: 1 leader_uuid: "836a86528e9f438184257661265d9531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836a86528e9f438184257661265d9531" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38639 } } }
I20260620 15:00:47.951750 2141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:47.951844 2140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "836a86528e9f438184257661265d9531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "836a86528e9f438184257661265d9531" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38639 } } }
I20260620 15:00:47.951962 2140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:47.952020 2148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:47.952787 2148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:47.955024 2148 catalog_manager.cc:1347] Generated new cluster ID: 89f04c05e3a74ede82eb9350ff303473
I20260620 15:00:47.955097 2148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:47.975775 2148 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:47.976006 2148 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:47.982348 2148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 836a86528e9f438184257661265d9531: Generated new TSK 0
I20260620 15:00:47.982618 2148 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:47.985711 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2061
2026-06-20T15:00:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1407 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:48 dist-test-slave-7v06 krb5kdc[2160](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:48 dist-test-slave-7v06 krb5kdc[2160](info): set up 2 sockets
Jun 20 15:00:48 dist-test-slave-7v06 krb5kdc[2160](info): commencing operation
krb5kdc: starting...
W20260620 15:00:49.092852 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:49 dist-test-slave-7v06 krb5kdc[2160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:49.245528 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38339
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:38339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:49.343541 2173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:49.343827 2173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:49.343856 2173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:49.345378 2173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:49.345469 2173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:49.345485 2173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:49.345506 2173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:49.345520 2173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:49.347409 2173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:38339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:38339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:49.347710 2173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:49.347942 2173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:49.354250 2179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:49.354204 2181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:49.354274 2173 server_base.cc:1034] running on GCE node
W20260620 15:00:49.354204 2178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:49.354770 2173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:49.355160 2173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:49.356431 2173 hybrid_clock.cc:648] HybridClock initialized: now 1781967649356387 us; error 62 us; skew 500 ppm
Jun 20 15:00:49 dist-test-slave-7v06 krb5kdc[2160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967649, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:49.362506 2173 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:49.363034 2173 webserver.cc:460] Webserver started at http://127.12.116.190:35295/ using document root <none> and password file <none>
I20260620 15:00:49.363328 2173 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:49.363397 2173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:49.363544 2173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:49.365047 2173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "05241a2dd7564c5dbbfdac3ab6147371"
format_stamp: "Formatted at 2026-06-20 15:00:49 on dist-test-slave-7v06"
server_key: "12c5b3046979d8e2f2eb0f1cc889d6dc"
server_key_iv: "30fcd501950fce02284bbf179a8bc225"
server_key_version: "encryptionkey@0"
I20260620 15:00:49.365499 2173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "05241a2dd7564c5dbbfdac3ab6147371"
format_stamp: "Formatted at 2026-06-20 15:00:49 on dist-test-slave-7v06"
server_key: "12c5b3046979d8e2f2eb0f1cc889d6dc"
server_key_iv: "30fcd501950fce02284bbf179a8bc225"
server_key_version: "encryptionkey@0"
I20260620 15:00:49.367022 2173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:49.367983 2188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:49.368218 2173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:49.368371 2173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "05241a2dd7564c5dbbfdac3ab6147371"
format_stamp: "Formatted at 2026-06-20 15:00:49 on dist-test-slave-7v06"
server_key: "12c5b3046979d8e2f2eb0f1cc889d6dc"
server_key_iv: "30fcd501950fce02284bbf179a8bc225"
server_key_version: "encryptionkey@0"
I20260620 15:00:49.368463 2173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:49.382349 2173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:49.385027 2173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:49.385233 2173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:49.390650 2173 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:38339
I20260620 15:00:49.390923 2240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:38339 every 8 connection(s)
I20260620 15:00:49.391178 2173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:49.392216 2241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:49.393297 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2173
I20260620 15:00:49.393486 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:49.393807 12754 external_mini_cluster.cc:1428] Setting key 38ef992e4353f2c8d8c12536e2a3fcf6
I20260620 15:00:49.395292 2241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371: Bootstrap starting.
I20260620 15:00:49.395964 2241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:49.396303 2241 log.cc:824] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:49.397176 2241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371: No bootstrap required, opened a new log
I20260620 15:00:49.399415 2241 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05241a2dd7564c5dbbfdac3ab6147371" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38339 } }
I20260620 15:00:49.399622 2241 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:49.399667 2241 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05241a2dd7564c5dbbfdac3ab6147371, State: Initialized, Role: FOLLOWER
I20260620 15:00:49.399852 2241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05241a2dd7564c5dbbfdac3ab6147371" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38339 } }
I20260620 15:00:49.399953 2241 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:49.400018 2241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:49.400084 2241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:49.400876 2241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05241a2dd7564c5dbbfdac3ab6147371" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38339 } }
I20260620 15:00:49.401024 2241 leader_election.cc:302] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05241a2dd7564c5dbbfdac3ab6147371; no voters:
I20260620 15:00:49.401265 2241 leader_election.cc:288] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:49.401381 2246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:49.401646 2241 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:49.401716 2246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [term 1 LEADER]: Becoming Leader. State: Replica: 05241a2dd7564c5dbbfdac3ab6147371, State: Running, Role: LEADER
Jun 20 15:00:49 dist-test-slave-7v06 krb5kdc[2160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:49.402206 2246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05241a2dd7564c5dbbfdac3ab6147371" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38339 } }
I20260620 15:00:49.402740 2248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05241a2dd7564c5dbbfdac3ab6147371. Latest consensus state: current_term: 1 leader_uuid: "05241a2dd7564c5dbbfdac3ab6147371" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05241a2dd7564c5dbbfdac3ab6147371" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38339 } } }
I20260620 15:00:49.402907 2248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:49.403031 2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05241a2dd7564c5dbbfdac3ab6147371" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05241a2dd7564c5dbbfdac3ab6147371" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 38339 } } }
I20260620 15:00:49.403119 2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:49.404101 2255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:49.405803 2255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:49.409042 2255 catalog_manager.cc:1347] Generated new cluster ID: 44b6dfb0d3c64ca18221724408fcfbbc
I20260620 15:00:49.409142 2255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:49.409934 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:49.394571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39989 (local address 127.12.116.190:38339)
0620 15:00:49.394772 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:49.394782 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:49.394809 (+ 27us) server_negotiation.cc:407] Connection header received
0620 15:00:49.395251 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:49.395258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:49.395309 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:49.395494 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:49.396387 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:49.397445 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:49.398226 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:49.398701 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:49.398827 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:49.402925 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:49.402931 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:49.402932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:49.402947 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:49.407171 (+ 4224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:49.407822 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:49.407828 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:49.407829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:49.408006 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:49.408565 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:49.408568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:49.408569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:49.409033 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:49.409286 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:49.409474 (+ 188us) server_negotiation.cc:299] Negotiation successful
0620 15:00:49.409669 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
I20260620 15:00:49.411321 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:49.416198 2255 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:49.417016 2255 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:49.419729 2255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05241a2dd7564c5dbbfdac3ab6147371: Generated new TSK 0
I20260620 15:00:49.419974 2255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:49.423339 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:49.413269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46289 (local address 127.12.116.190:38339)
0620 15:00:49.413325 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:49.413327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:49.413537 (+ 210us) server_negotiation.cc:407] Connection header received
0620 15:00:49.413636 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:49.413637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:49.413650 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:49.413705 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:49.414617 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:49.415454 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:49.416593 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:49.416955 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:49.417033 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:49.419294 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:49.419349 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:49.419352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:49.419370 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:49.421457 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:49.422033 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:49.422034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:49.422035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:49.422153 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:49.422472 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:49.422475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:49.422475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:49.422670 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:49.422807 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:49.423055 (+ 248us) server_negotiation.cc:299] Negotiation successful
0620 15:00:49.423173 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 15:00:49.425711 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2173
2026-06-20T15:00:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:49 dist-test-slave-7v06 krb5kdc[2272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:49 dist-test-slave-7v06 krb5kdc[2272](info): set up 2 sockets
Jun 20 15:00:49 dist-test-slave-7v06 krb5kdc[2272](info): commencing operation
krb5kdc: starting...
W20260620 15:00:50.525228 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:50 dist-test-slave-7v06 krb5kdc[2272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:50.671233 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36339
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:50.764940 2285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:50.765290 2285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:50.765345 2285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:50.766839 2285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:50.766938 2285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:50.766963 2285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:50.766986 2285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:50.767006 2285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:50.768946 2285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:50.769331 2285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:50.769767 2285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:50.776286 2290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:50.776578 2291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:50.776659 2293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:50.776818 2285 server_base.cc:1034] running on GCE node
I20260620 15:00:50.777136 2285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:50.777516 2285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:50.778728 2285 hybrid_clock.cc:648] HybridClock initialized: now 1781967650778708 us; error 54 us; skew 500 ppm
Jun 20 15:00:50 dist-test-slave-7v06 krb5kdc[2272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967650, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:50.782078 2285 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:50.782860 2285 webserver.cc:460] Webserver started at http://127.12.116.190:44071/ using document root <none> and password file <none>
I20260620 15:00:50.783201 2285 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:50.783283 2285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:50.783447 2285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:50.784741 2285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "e421cc30d4d047159a9d85b47de13879"
format_stamp: "Formatted at 2026-06-20 15:00:50 on dist-test-slave-7v06"
server_key: "16d4ae19f5c58d3a0b228a9932fa2431"
server_key_iv: "2bfbd3fb445039e0c41a9a78c0cb27cf"
server_key_version: "encryptionkey@0"
I20260620 15:00:50.785151 2285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "e421cc30d4d047159a9d85b47de13879"
format_stamp: "Formatted at 2026-06-20 15:00:50 on dist-test-slave-7v06"
server_key: "16d4ae19f5c58d3a0b228a9932fa2431"
server_key_iv: "2bfbd3fb445039e0c41a9a78c0cb27cf"
server_key_version: "encryptionkey@0"
I20260620 15:00:50.786886 2285 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:50.788297 2300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:50.789258 2285 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 15:00:50.789434 2285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "e421cc30d4d047159a9d85b47de13879"
format_stamp: "Formatted at 2026-06-20 15:00:50 on dist-test-slave-7v06"
server_key: "16d4ae19f5c58d3a0b228a9932fa2431"
server_key_iv: "2bfbd3fb445039e0c41a9a78c0cb27cf"
server_key_version: "encryptionkey@0"
I20260620 15:00:50.789542 2285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:50.798733 2285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:50.802445 2285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:50.802680 2285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:50.807384 2285 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:36339
I20260620 15:00:50.807438 2352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:36339 every 8 connection(s)
I20260620 15:00:50.807855 2285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:50.808274 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2285
I20260620 15:00:50.808583 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:50.808876 12754 external_mini_cluster.cc:1428] Setting key 3cfe8433dfefa7102108a0b318d00e1b
I20260620 15:00:50.809343 2353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:50.812963 2353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879: Bootstrap starting.
I20260620 15:00:50.813750 2353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:50.814051 2353 log.cc:824] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:50.814994 2353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879: No bootstrap required, opened a new log
I20260620 15:00:50.815820 2356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:50.809542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49407 (local address 127.12.116.190:36339)
0620 15:00:50.809753 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:50.809762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:50.809797 (+ 35us) server_negotiation.cc:407] Connection header received
0620 15:00:50.810547 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:50.810555 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:50.810614 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:50.810756 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:50.811049 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:50.812015 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:50.813316 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:50.813783 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:50.813931 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:50.814839 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:50.814844 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:50.814844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:50.815016 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:50.815048 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:50.815060 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:50.815197 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:50.815444 (+ 247us) server_negotiation.cc:299] Negotiation successful
0620 15:00:50.815516 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260620 15:00:50.817139 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:50.818919 2353 raft_consensus.cc:348] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e421cc30d4d047159a9d85b47de13879" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36339 } }
I20260620 15:00:50.819172 2353 raft_consensus.cc:374] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:50.819221 2353 raft_consensus.cc:729] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e421cc30d4d047159a9d85b47de13879, State: Initialized, Role: FOLLOWER
I20260620 15:00:50.819365 2353 consensus_queue.cc:260] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e421cc30d4d047159a9d85b47de13879" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36339 } }
I20260620 15:00:50.819466 2353 raft_consensus.cc:388] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:50.819514 2353 raft_consensus.cc:482] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:50.819567 2353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:50.820261 2353 raft_consensus.cc:504] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e421cc30d4d047159a9d85b47de13879" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36339 } }
I20260620 15:00:50.820416 2353 leader_election.cc:302] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e421cc30d4d047159a9d85b47de13879; no voters:
I20260620 15:00:50.820647 2353 leader_election.cc:288] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:50.820676 2363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:50.820806 2363 raft_consensus.cc:686] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [term 1 LEADER]: Becoming Leader. State: Replica: e421cc30d4d047159a9d85b47de13879, State: Running, Role: LEADER
I20260620 15:00:50.820897 2363 consensus_queue.cc:237] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e421cc30d4d047159a9d85b47de13879" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36339 } }
I20260620 15:00:50.820940 2353 sys_catalog.cc:564] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:50.821244 2363 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e421cc30d4d047159a9d85b47de13879. Latest consensus state: current_term: 1 leader_uuid: "e421cc30d4d047159a9d85b47de13879" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e421cc30d4d047159a9d85b47de13879" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36339 } } }
I20260620 15:00:50.821323 2363 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:50.821554 2364 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e421cc30d4d047159a9d85b47de13879" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e421cc30d4d047159a9d85b47de13879" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 36339 } } }
I20260620 15:00:50.821659 2364 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:50.821812 2367 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:50.822400 2367 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:50.822691 2356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:50.818955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48379 (local address 127.12.116.190:36339)
0620 15:00:50.819000 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:50.819003 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:50.819103 (+ 100us) server_negotiation.cc:407] Connection header received
0620 15:00:50.819199 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:50.819200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:50.819213 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:50.819280 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:50.819441 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:50.820044 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:50.821019 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:50.821291 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:50.821339 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:50.822347 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:50.822348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:50.822349 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:50.822355 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:50.822372 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:50.822377 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:50.822405 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:50.822585 (+ 180us) server_negotiation.cc:299] Negotiation successful
0620 15:00:50.822613 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 15:00:50.824306 2367 catalog_manager.cc:1347] Generated new cluster ID: 06173c5014e142a8b3d0f566c54f9f8d
I20260620 15:00:50.824393 2367 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:50.842931 2367 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:50.843528 2367 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:50.847702 2367 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e421cc30d4d047159a9d85b47de13879: Generated new TSK 0
I20260620 15:00:50.848011 2367 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:50.856161 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2285
2026-06-20T15:00:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:50 dist-test-slave-7v06 krb5kdc[2384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:50 dist-test-slave-7v06 krb5kdc[2384](info): set up 2 sockets
Jun 20 15:00:50 dist-test-slave-7v06 krb5kdc[2384](info): commencing operation
krb5kdc: starting...
W20260620 15:00:51.964653 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:52 dist-test-slave-7v06 krb5kdc[2384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:52.113305 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34367
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:44859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:34367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:52.214672 2397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:52.215107 2397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:52.215161 2397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:52.217329 2397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:52.217438 2397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:52.217471 2397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:52.217495 2397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:52.217527 2397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:52.219720 2397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:44859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:34367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:34367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:52.220155 2397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:52.220515 2397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:52.227810 2403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:52.228081 2402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:52.227990 2405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:52.228380 2397 server_base.cc:1034] running on GCE node
I20260620 15:00:52.228741 2397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:52.229074 2397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:52.230278 2397 hybrid_clock.cc:648] HybridClock initialized: now 1781967652230221 us; error 82 us; skew 500 ppm
Jun 20 15:00:52 dist-test-slave-7v06 krb5kdc[2384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967652, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:52.234890 2397 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:52.235692 2397 webserver.cc:460] Webserver started at http://127.12.116.190:40305/ using document root <none> and password file <none>
I20260620 15:00:52.235975 2397 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:52.236039 2397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:52.236181 2397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:52.237664 2397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "7f665f0e57ff4cc7af48dee8991f73ea"
format_stamp: "Formatted at 2026-06-20 15:00:52 on dist-test-slave-7v06"
server_key: "0b34c3d93cccd90bdef7b78548450b26"
server_key_iv: "8ffb72b0a8e2fa0428453b6aaa16fa9a"
server_key_version: "encryptionkey@0"
I20260620 15:00:52.238161 2397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "7f665f0e57ff4cc7af48dee8991f73ea"
format_stamp: "Formatted at 2026-06-20 15:00:52 on dist-test-slave-7v06"
server_key: "0b34c3d93cccd90bdef7b78548450b26"
server_key_iv: "8ffb72b0a8e2fa0428453b6aaa16fa9a"
server_key_version: "encryptionkey@0"
I20260620 15:00:52.239847 2397 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 15:00:52.241178 2412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:52.241658 2397 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:52.241796 2397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "7f665f0e57ff4cc7af48dee8991f73ea"
format_stamp: "Formatted at 2026-06-20 15:00:52 on dist-test-slave-7v06"
server_key: "0b34c3d93cccd90bdef7b78548450b26"
server_key_iv: "8ffb72b0a8e2fa0428453b6aaa16fa9a"
server_key_version: "encryptionkey@0"
I20260620 15:00:52.241905 2397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:52.245893 2397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:52.249285 2397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:52.249509 2397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:52.255517 2397 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:34367
I20260620 15:00:52.255638 2464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:34367 every 8 connection(s)
I20260620 15:00:52.256551 2397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:52.257946 2465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:52.259424 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2397
I20260620 15:00:52.259559 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:52.259764 12754 external_mini_cluster.cc:1428] Setting key 211ee9f316e6f321f4dd9daf626f210c
I20260620 15:00:52.261319 2465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea: Bootstrap starting.
I20260620 15:00:52.262337 2465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:52.262676 2468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:52.260481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42613 (local address 127.12.116.190:34367)
0620 15:00:52.260677 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:52.260686 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:52.260718 (+ 32us) server_negotiation.cc:407] Connection header received
0620 15:00:52.261164 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:52.261172 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:52.261199 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:52.261330 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:52.262209 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:52.262213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:52.262213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:52.262217 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:52.262260 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:52.262271 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:52.262342 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:52.262454 (+ 112us) server_negotiation.cc:299] Negotiation successful
0620 15:00:52.262504 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260620 15:00:52.262728 2465 log.cc:824] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:52.263696 2465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea: No bootstrap required, opened a new log
I20260620 15:00:52.264214 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:52.266279 2465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34367 } }
I20260620 15:00:52.266515 2465 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 15:00:52.266564 2465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f665f0e57ff4cc7af48dee8991f73ea, State: Initialized, Role: FOLLOWER
I20260620 15:00:52.266811 2465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34367 } }
I20260620 15:00:52.266970 2465 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 15:00:52.267017 2465 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 15:00:52.267089 2465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:52.267160 2468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:52.265796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33661 (local address 127.12.116.190:34367)
0620 15:00:52.265843 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:52.265845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:52.265913 (+ 68us) server_negotiation.cc:407] Connection header received
0620 15:00:52.265993 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:52.265994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:52.265998 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:52.266042 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:52.266789 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:52.266791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:52.266792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 15:00:52.266797 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:52.266816 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 15:00:52.266822 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:52.266879 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:52.267026 (+ 147us) server_negotiation.cc:299] Negotiation successful
0620 15:00:52.267041 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 15:00:52.267993 2465 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34367 } }
I20260620 15:00:52.268118 2465 leader_election.cc:302] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f665f0e57ff4cc7af48dee8991f73ea; no voters:
I20260620 15:00:52.268426 2465 leader_election.cc:288] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 15:00:52.268460 2475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:52.268592 2475 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [term 1 LEADER]: Becoming Leader. State: Replica: 7f665f0e57ff4cc7af48dee8991f73ea, State: Running, Role: LEADER
I20260620 15:00:52.268680 2475 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34367 } }
I20260620 15:00:52.268762 2465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:52.269075 2476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f665f0e57ff4cc7af48dee8991f73ea. Latest consensus state: current_term: 1 leader_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34367 } } }
I20260620 15:00:52.269279 2477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f665f0e57ff4cc7af48dee8991f73ea" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 34367 } } }
I20260620 15:00:52.269415 2476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:52.269551 2477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:52.269953 2484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:52.270511 2484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:52.272946 2484 catalog_manager.cc:1347] Generated new cluster ID: 47ec78231e7249e39bca7878a21e5dfc
I20260620 15:00:52.273087 2484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:52.278304 2484 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:52.278528 2484 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:52.285566 2484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f665f0e57ff4cc7af48dee8991f73ea: Generated new TSK 0
I20260620 15:00:52.286258 2484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 15:00:52.294755 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2397
2026-06-20T15:00:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1440 ms)
[----------] 18 tests from AuthTokenIssuingTest (26729 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:52 dist-test-slave-7v06 krb5kdc[2496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:52 dist-test-slave-7v06 krb5kdc[2496](info): set up 2 sockets
Jun 20 15:00:52 dist-test-slave-7v06 krb5kdc[2496](info): commencing operation
krb5kdc: starting...
W20260620 15:00:53.396878 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:53.541400 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:44991
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:44991,127.12.116.189:44931,127.12.116.188:45983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:53.637142 2509 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 15:00:53.637447 2509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:53.637483 2509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:53.637535 2509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:53.639005 2509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:53.639101 2509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:53.639313 2509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:53.639366 2509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:53.639398 2509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:53.641352 2509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:44991,127.12.116.189:44931,127.12.116.188:45983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:44991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:53.641705 2509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:53.641968 2509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:53.647789 2514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:53.647862 2517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:53.647781 2515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:53.648231 2509 server_base.cc:1034] running on GCE node
I20260620 15:00:53.648633 2509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:53.648993 2509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:53.650218 2509 hybrid_clock.cc:648] HybridClock initialized: now 1781967653650188 us; error 48 us; skew 500 ppm
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:53.653738 2509 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:53.654294 2509 webserver.cc:460] Webserver started at http://127.12.116.190:38003/ using document root <none> and password file <none>
I20260620 15:00:53.654541 2509 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:53.654628 2509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:53.654789 2509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:53.656085 2509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "95ef2bc6aabd472e93fab579627135b8"
format_stamp: "Formatted at 2026-06-20 15:00:53 on dist-test-slave-7v06"
server_key: "1c7966be725079b97254ba1d74963941"
server_key_iv: "953cacba225e65a946282e8a9dbf00f3"
server_key_version: "encryptionkey@0"
I20260620 15:00:53.656544 2509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "95ef2bc6aabd472e93fab579627135b8"
format_stamp: "Formatted at 2026-06-20 15:00:53 on dist-test-slave-7v06"
server_key: "1c7966be725079b97254ba1d74963941"
server_key_iv: "953cacba225e65a946282e8a9dbf00f3"
server_key_version: "encryptionkey@0"
I20260620 15:00:53.658380 2509 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260620 15:00:53.659628 2524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:53.659909 2509 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:53.660043 2509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "95ef2bc6aabd472e93fab579627135b8"
format_stamp: "Formatted at 2026-06-20 15:00:53 on dist-test-slave-7v06"
server_key: "1c7966be725079b97254ba1d74963941"
server_key_iv: "953cacba225e65a946282e8a9dbf00f3"
server_key_version: "encryptionkey@0"
I20260620 15:00:53.660125 2509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:53.678804 2509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:53.681334 2509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:53.681468 2509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:53.685659 2509 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:44991
I20260620 15:00:53.685698 2576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:44991 every 8 connection(s)
I20260620 15:00:53.686101 2509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:53.687093 2577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:53.688578 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2509
I20260620 15:00:53.688714 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:53.688895 12754 external_mini_cluster.cc:1428] Setting key 36534c94587a5393587e90375ebc136b
I20260620 15:00:53.689080 2577 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.116.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.189@KRBTEST.COM" created.
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:53.705468 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.690295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37420 (local address 127.12.116.190:44991)
0620 15:00:53.690546 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:53.690559 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:53.690756 (+ 197us) server_negotiation.cc:407] Connection header received
0620 15:00:53.691377 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:53.691379 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:53.691414 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:53.691513 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:53.692199 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.693624 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.694606 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.695181 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.695318 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.701582 (+ 6264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:53.701593 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:53.701593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:53.701603 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:53.703387 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.703927 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.703930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.703931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.704033 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.704417 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.704419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.704419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.704702 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:53.704781 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:53.705056 (+ 275us) server_negotiation.cc:299] Negotiation successful
0620 15:00:53.705175 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
I20260620 15:00:53.705477 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.690211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:44991 (local address 127.0.0.1:37420)
0620 15:00:53.690610 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.690661 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:53.691208 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:53.691607 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:53.691611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:53.691901 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:53.692084 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.692088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.693740 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.693741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.694504 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.694507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.695396 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.695399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.695529 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.696486 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:53.696497 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:53.701462 (+ 4965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:53.703506 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.703514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.703518 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.703823 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.704114 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.704115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.704116 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.704244 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.704798 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:53.704807 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:53.704901 (+ 94us) client_negotiation.cc:769] Sending connection context
0620 15:00:53.705026 (+ 125us) client_negotiation.cc:240] Negotiation successful
0620 15:00:53.705271 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":40,"thread_start_us":120,"threads_started":1}
I20260620 15:00:53.706441 2577 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:53.706873 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.706725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58586)
0620 15:00:53.706781 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.706839 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260620 15:00:53.707029 2525 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
I20260620 15:00:53.707893 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.707756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58592)
0620 15:00:53.707820 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.707857 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260620 15:00:53.708050 2577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:44931: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab.
Entry for principal kudu/127.12.116.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab.
I20260620 15:00:53.721969 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:44931
--webserver_interface=127.12.116.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab
--principal=kudu/127.12.116.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:44991,127.12.116.189:44931,127.12.116.188:45983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 15:00:53.757325 2577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } attempt: 1
I20260620 15:00:53.758081 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.757853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58594)
0620 15:00:53.757947 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.758033 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260620 15:00:53.758729 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.758602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58602)
0620 15:00:53.758663 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.758704 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260620 15:00:53.758906 2577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:44931: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
W20260620 15:00:53.817853 2584 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 15:00:53.818122 2584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:53.818149 2584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:53.818174 2584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:53.819479 2584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:53.819526 2584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:53.819541 2584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:53.819554 2584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:53.819567 2584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:53.821285 2584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:44991,127.12.116.189:44931,127.12.116.188:45983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab
--principal=kudu/127.12.116.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:44931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.116.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:53.821549 2584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:53.821748 2584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 15:00:53.827142 2577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } attempt: 2
W20260620 15:00:53.827418 2592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:53.827786 2589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:53.827963 2584 server_base.cc:1034] running on GCE node
I20260620 15:00:53.828019 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.827497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58606)
0620 15:00:53.827926 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.827967 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402}
W20260620 15:00:53.828071 2590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:53.828449 2584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:53.828466 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.828288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58608)
0620 15:00:53.828399 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.828434 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260620 15:00:53.828609 2577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:44931: Network error: Client connection negotiation failed: client connection to 127.12.116.189:44931: connect: Connection refused (error 111)
I20260620 15:00:53.828842 2584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:53.830132 2584 hybrid_clock.cc:648] HybridClock initialized: now 1781967653830104 us; error 30 us; skew 500 ppm
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:53.834064 2584 init.cc:377] Logged in from keytab as kudu/127.12.116.189@KRBTEST.COM (short username kudu)
I20260620 15:00:53.834775 2584 webserver.cc:460] Webserver started at http://127.12.116.189:42547/ using document root <none> and password file <none>
I20260620 15:00:53.835053 2584 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:53.835129 2584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:53.835292 2584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:53.836895 2584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data/instance:
uuid: "170c2c850c8c4759ac79fbd02ed278b3"
format_stamp: "Formatted at 2026-06-20 15:00:53 on dist-test-slave-7v06"
server_key: "6622f7a5d2f167f27d6812d0f6084458"
server_key_iv: "19febb5c5f54862cf9d155de01097eb4"
server_key_version: "encryptionkey@0"
I20260620 15:00:53.837318 2584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal/instance:
uuid: "170c2c850c8c4759ac79fbd02ed278b3"
format_stamp: "Formatted at 2026-06-20 15:00:53 on dist-test-slave-7v06"
server_key: "6622f7a5d2f167f27d6812d0f6084458"
server_key_iv: "19febb5c5f54862cf9d155de01097eb4"
server_key_version: "encryptionkey@0"
I20260620 15:00:53.838960 2584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:53.839963 2599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:53.840407 2584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:53.840525 2584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal
uuid: "170c2c850c8c4759ac79fbd02ed278b3"
format_stamp: "Formatted at 2026-06-20 15:00:53 on dist-test-slave-7v06"
server_key: "6622f7a5d2f167f27d6812d0f6084458"
server_key_iv: "19febb5c5f54862cf9d155de01097eb4"
server_key_version: "encryptionkey@0"
I20260620 15:00:53.840641 2584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:53.861084 2584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:53.863744 2584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:53.863961 2584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:53.868778 2584 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.189:44931
I20260620 15:00:53.869366 2584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
I20260620 15:00:53.869400 2651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.189:44931 every 8 connection(s)
I20260620 15:00:53.870230 2652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:53.872030 2652 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:53.879063 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2584
I20260620 15:00:53.879199 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-1/wal/instance
I20260620 15:00:53.879446 12754 external_mini_cluster.cc:1428] Setting key 4c08dd8ff8db4dd8574238fadc226e72
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:53.885365 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.873082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37436 (local address 127.12.116.190:44991)
0620 15:00:53.873189 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:53.873191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:53.873379 (+ 188us) server_negotiation.cc:407] Connection header received
0620 15:00:53.873934 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:53.873935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:53.874037 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:53.874189 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:53.875462 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.876052 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.877581 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.877872 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.878205 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.881893 (+ 3688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:53.881895 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:53.881895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:53.881910 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:53.883485 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.884065 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.884066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.884066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.884139 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.884474 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.884475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.884475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.884630 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:53.884709 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:53.885122 (+ 413us) server_negotiation.cc:299] Negotiation successful
0620 15:00:53.885253 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260620 15:00:53.885521 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.872957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:44991 (local address 127.0.0.1:37436)
0620 15:00:53.873183 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.873252 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:53.873825 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:53.874495 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:53.874502 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:53.874931 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:53.875250 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.875257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.876288 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.876290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.877408 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.877412 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.878216 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.878218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.878381 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.879348 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:53.879360 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:53.881737 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:53.883638 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.883653 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.883656 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.883952 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.884215 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.884216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.884216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.884399 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.884712 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:53.884720 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:53.884890 (+ 170us) client_negotiation.cc:769] Sending connection context
0620 15:00:53.885047 (+ 157us) client_negotiation.cc:240] Negotiation successful
0620 15:00:53.885259 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":130,"threads_started":1}
I20260620 15:00:53.886646 2652 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.116.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.188@KRBTEST.COM" created.
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 15:00:53.897892 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.887168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58610 (local address 127.12.116.189:44931)
0620 15:00:53.887361 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:53.887367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:53.887420 (+ 53us) server_negotiation.cc:407] Connection header received
0620 15:00:53.887481 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:53.887484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:53.887498 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:53.887621 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:53.887907 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.888714 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.889544 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.889918 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.890113 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.893775 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:53.893803 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:53.893804 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:53.893824 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:53.896143 (+ 2319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.896748 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.896752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.896753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.896822 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.897071 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.897072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.897072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.897307 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:53.897406 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:53.897616 (+ 210us) server_negotiation.cc:299] Negotiation successful
0620 15:00:53.897772 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":155,"thread_start_us":124,"threads_started":1}
I20260620 15:00:53.897894 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.887048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58610)
0620 15:00:53.887351 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.887364 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:53.887422 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:53.887592 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:53.887593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:53.887772 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:53.887829 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.887831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.888807 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.888808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.889448 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.889450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.890109 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.890111 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.890247 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.891026 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:53.891032 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:53.893609 (+ 2577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:53.896283 (+ 2674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.896285 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.896286 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.896626 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.896897 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.896898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.896898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.896981 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.897397 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:53.897399 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:53.897464 (+ 65us) client_negotiation.cc:769] Sending connection context
0620 15:00:53.897551 (+ 87us) client_negotiation.cc:240] Negotiation successful
0620 15:00:53.897700 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288}
I20260620 15:00:53.898912 2652 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:53.899454 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.899282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53804)
0620 15:00:53.899348 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.899416 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260620 15:00:53.899629 2603 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
I20260620 15:00:53.900209 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.900082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53806)
0620 15:00:53.900137 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.900175 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260620 15:00:53.900398 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:45983: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab.
Entry for principal kudu/127.12.116.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab.
I20260620 15:00:53.917333 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:45983
--webserver_interface=127.12.116.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab
--principal=kudu/127.12.116.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:35959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:44991,127.12.116.189:44931,127.12.116.188:45983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 15:00:53.919787 2577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } attempt: 3
Jun 20 15:00:53 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 15:00:53.930655 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.920429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58620)
0620 15:00:53.920567 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.920613 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:53.920690 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:53.921055 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:53.921057 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:53.921291 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:53.921388 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.921390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.922580 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.922582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.923603 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:53.923608 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.924158 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.924159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:53.924270 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.924848 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:53.924855 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:53.926642 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:53.929049 (+ 2407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.929052 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.929053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.929373 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.929703 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:53.929704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:53.929705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:53.929790 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:53.930236 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:53.930238 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:53.930312 (+ 74us) client_negotiation.cc:769] Sending connection context
0620 15:00:53.930406 (+ 94us) client_negotiation.cc:240] Negotiation successful
0620 15:00:53.930529 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260620 15:00:53.930701 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.920720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58620 (local address 127.12.116.189:44931)
0620 15:00:53.920791 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:53.920793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:53.920800 (+ 7us) server_negotiation.cc:407] Connection header received
0620 15:00:53.920824 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:53.920825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:53.920837 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:53.920885 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:53.921549 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.922345 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.923757 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:53.924025 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:53.924138 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:53.926794 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:53.926796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:53.926796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:53.926805 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:53.928893 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.929526 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.929528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.929529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.929617 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:53.929921 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:53.929924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:53.929924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:53.930132 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:53.930229 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:53.930509 (+ 280us) server_negotiation.cc:299] Negotiation successful
0620 15:00:53.930628 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 15:00:53.931202 2577 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:53.931615 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.931489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53818)
0620 15:00:53.931547 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.931585 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260620 15:00:53.932224 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.932104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53828)
0620 15:00:53.932158 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.932196 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260620 15:00:53.932440 2577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:45983: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
I20260620 15:00:53.949684 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } attempt: 1
I20260620 15:00:53.950592 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.950182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53832)
0620 15:00:53.950416 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.950524 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260620 15:00:53.951259 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.951096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53836)
0620 15:00:53.951173 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.951216 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260620 15:00:53.951656 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:45983: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
I20260620 15:00:53.963616 2577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } attempt: 1
I20260620 15:00:53.964195 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.964018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53838)
0620 15:00:53.964090 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.964149 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260620 15:00:53.964778 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:53.964545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53854)
0620 15:00:53.964692 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:53.964744 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
W20260620 15:00:53.964869 2577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:45983: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
I20260620 15:00:54.019893 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } attempt: 2
I20260620 15:00:54.020493 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.020357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53856)
0620 15:00:54.020427 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.020466 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260620 15:00:54.021445 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.021267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53860)
0620 15:00:54.021370 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.021410 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260620 15:00:54.021618 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:45983: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
W20260620 15:00:54.021198 2659 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 15:00:54.021921 2659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:54.022003 2659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:54.022055 2659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:54.023782 2659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:54.023859 2659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:54.023885 2659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:54.023906 2659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:54.023933 2659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:54.026338 2659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:35959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:44991,127.12.116.189:44931,127.12.116.188:45983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab
--principal=kudu/127.12.116.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:45983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.116.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:54.026918 2659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:54.027215 2659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:54.033339 2666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:54.033342 2668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:54.033342 2665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:54.033812 2659 server_base.cc:1034] running on GCE node
I20260620 15:00:54.034130 2659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:54.034490 2659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:54.035667 2659 hybrid_clock.cc:648] HybridClock initialized: now 1781967654035655 us; error 31 us; skew 500 ppm
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967654, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:54.038579 2659 init.cc:377] Logged in from keytab as kudu/127.12.116.188@KRBTEST.COM (short username kudu)
I20260620 15:00:54.039105 2659 webserver.cc:460] Webserver started at http://127.12.116.188:35709/ using document root <none> and password file <none>
I20260620 15:00:54.039392 2659 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:54.039443 2659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:54.039585 2659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:54.040053 2577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } attempt: 2
I20260620 15:00:54.040570 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.040433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53876)
0620 15:00:54.040505 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.040541 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 15:00:54.040887 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.040794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53890)
0620 15:00:54.040839 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.040867 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260620 15:00:54.040970 2577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:45983: Network error: Client connection negotiation failed: client connection to 127.12.116.188:45983: connect: Connection refused (error 111)
I20260620 15:00:54.041332 2659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data/instance:
uuid: "e40872e77d94447f96f2b644164f717c"
format_stamp: "Formatted at 2026-06-20 15:00:54 on dist-test-slave-7v06"
server_key: "f89bdbda4129c9a55bb59d7542794a9e"
server_key_iv: "0c1e6360e904c29d5d85e4cfb923deae"
server_key_version: "encryptionkey@0"
I20260620 15:00:54.041714 2659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal/instance:
uuid: "e40872e77d94447f96f2b644164f717c"
format_stamp: "Formatted at 2026-06-20 15:00:54 on dist-test-slave-7v06"
server_key: "f89bdbda4129c9a55bb59d7542794a9e"
server_key_iv: "0c1e6360e904c29d5d85e4cfb923deae"
server_key_version: "encryptionkey@0"
I20260620 15:00:54.043560 2659 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 15:00:54.044673 2675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:54.044843 2659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 15:00:54.044950 2659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal
uuid: "e40872e77d94447f96f2b644164f717c"
format_stamp: "Formatted at 2026-06-20 15:00:54 on dist-test-slave-7v06"
server_key: "f89bdbda4129c9a55bb59d7542794a9e"
server_key_iv: "0c1e6360e904c29d5d85e4cfb923deae"
server_key_version: "encryptionkey@0"
I20260620 15:00:54.045033 2659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:54.060084 2659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:54.063900 2659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:54.064107 2659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:54.068974 2659 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.188:45983
I20260620 15:00:54.069339 2727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.188:45983 every 8 connection(s)
I20260620 15:00:54.069429 2659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
I20260620 15:00:54.070499 2728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:54.072466 2728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:54.075103 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2659
I20260620 15:00:54.075234 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781967351633327-12754-0/minicluster-data/master-2/wal/instance
I20260620 15:00:54.075630 12754 external_mini_cluster.cc:1428] Setting key d2b1f1f06b03e38f719fb75f685360b4
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967654, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 15:00:54.086143 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.073469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37450 (local address 127.12.116.190:44991)
0620 15:00:54.073617 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.073619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.073839 (+ 220us) server_negotiation.cc:407] Connection header received
0620 15:00:54.074479 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.074481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.074495 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.074554 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.075837 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.076620 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.078139 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.078487 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.078587 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.082329 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.082337 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.082337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.082345 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.084458 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.085003 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.085004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.085005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.085078 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.085376 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.085377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.085378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.085545 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.085627 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.085912 (+ 285us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.086011 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260620 15:00:54.086285 2730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.073373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:44991 (local address 127.0.0.1:37450)
0620 15:00:54.073665 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.073734 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:54.074350 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:54.074642 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:54.074646 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:54.075082 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:54.075666 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.075675 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.076719 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.076721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.078023 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.078026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.078694 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.078696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.079016 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.079987 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:54.080016 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:54.082201 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:54.084542 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.084553 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.084557 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.084914 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.085147 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.085148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.085148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.085306 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.085616 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:54.085627 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:54.085767 (+ 140us) client_negotiation.cc:769] Sending connection context
0620 15:00:54.085863 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 15:00:54.086016 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":139,"threads_started":1}
I20260620 15:00:54.086992 2728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:54.088042 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.076169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53894 (local address 127.12.116.188:45983)
0620 15:00:54.076399 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.076405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.076430 (+ 25us) server_negotiation.cc:407] Connection header received
0620 15:00:54.076519 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.076523 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.076548 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.076643 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.077598 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.078716 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.079982 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.080511 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.080592 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.083967 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.083981 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.083981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.083992 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.086156 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.086947 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.086950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.086950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.087030 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.087370 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.087371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.087371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.087583 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.087743 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.087831 (+ 88us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.087920 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":117,"threads_started":1}
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967654, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:54.095891 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.087404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58628 (local address 127.12.116.189:44931)
0620 15:00:54.087479 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.087481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.087489 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:54.087521 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.087522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.087530 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.087604 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.087894 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.088675 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.089505 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.089871 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.089945 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.092154 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.092156 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.092156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.092163 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.094324 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.094723 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.094724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.094725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.094787 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.095106 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.095109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.095109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.095326 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.095441 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.095644 (+ 203us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.095758 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260620 15:00:54.095891 2730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.087299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:44931 (local address 127.0.0.1:58628)
0620 15:00:54.087354 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.087364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:54.087401 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:54.087610 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:54.087611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:54.087759 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:54.087816 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.087818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.088814 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.088815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.089425 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.089427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.089973 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.089974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.090074 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.090526 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:54.090531 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:54.092057 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:54.094440 (+ 2383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.094441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.094442 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.094631 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.094865 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.094866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.094866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.094930 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.095440 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:54.095441 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:54.095526 (+ 85us) client_negotiation.cc:769] Sending connection context
0620 15:00:54.095611 (+ 85us) client_negotiation.cc:240] Negotiation successful
0620 15:00:54.095758 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260620 15:00:54.097139 2728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:54.098948 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.089125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37466 (local address 127.12.116.190:44991)
0620 15:00:54.089187 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.089189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.089197 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:54.089222 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.089223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.089233 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.089292 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.089971 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.090614 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.091641 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.091901 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.091973 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.095048 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.095050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.095051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.095060 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.097016 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.097657 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.097659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.097659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.097737 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.097956 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.097957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.097957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.098133 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.098747 (+ 614us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.098784 (+ 37us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.098860 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967654, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 15:00:54.106668 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.097581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53898 (local address 127.12.116.188:45983)
0620 15:00:54.097628 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.097630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.097689 (+ 59us) server_negotiation.cc:407] Connection header received
0620 15:00:54.097801 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.097802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.097815 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.097876 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.098246 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.098889 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.099795 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.100084 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.100171 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.102797 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.102800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.102801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.102816 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.105223 (+ 2407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.105744 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.105746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.105746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.105804 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.106022 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.106023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.106023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.106186 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.106261 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.106408 (+ 147us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.106547 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":22}
I20260620 15:00:54.106668 2730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.097501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53898)
0620 15:00:54.097628 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.097639 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:54.097696 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:54.097891 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:54.097892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:54.098085 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:54.098140 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.098142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.098974 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.098975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.099693 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.099696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.100174 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.100175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.100225 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.100790 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:54.100795 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:54.102674 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:54.105333 (+ 2659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.105335 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.105335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.105611 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.105889 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.105890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.105890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.105956 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.106265 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:54.106266 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:54.106306 (+ 40us) client_negotiation.cc:769] Sending connection context
0620 15:00:54.106386 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 15:00:54.106502 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260620 15:00:54.108696 2728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: Bootstrap starting.
I20260620 15:00:54.109740 2728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:54.109755 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.099886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.12.116.189:44931)
0620 15:00:54.100018 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.100020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.100120 (+ 100us) server_negotiation.cc:407] Connection header received
0620 15:00:54.100173 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.100174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.100185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.100253 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.100968 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.101781 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.102828 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.103041 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.103103 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.106377 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.106379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.106380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.106393 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.108430 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.108870 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.108871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.108872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.108942 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.109148 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.109149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.109149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.109284 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.109518 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.109558 (+ 40us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.109645 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260620 15:00:54.110128 2728 log.cc:824] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:54.111080 2728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: No bootstrap required, opened a new log
I20260620 15:00:54.111537 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:54.112754 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } attempt: 3
I20260620 15:00:54.112844 2551 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "95ef2bc6aabd472e93fab579627135b8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37466
I20260620 15:00:54.113701 2728 raft_consensus.cc:348] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.113894 2728 raft_consensus.cc:729] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e40872e77d94447f96f2b644164f717c, State: Initialized, Role: FOLLOWER
I20260620 15:00:54.114001 2728 consensus_queue.cc:260] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.114365 2728 sys_catalog.cc:564] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:54.114306 2734 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.114436 2734 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: This master's current role is: FOLLOWER
W20260620 15:00:54.117024 2745 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:54.117146 2745 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 15:00:54.117110 2659 master_runner.cc:186] Error getting master registration for 127.12.116.190:44991: OK, instance_id { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" instance_seqno: 1781967653684480 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 15:00:54.120797 2659 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 15:00:54.122040 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.113140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53910)
0620 15:00:54.113269 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.113283 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:54.113337 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:54.113562 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:54.113563 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:54.113761 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:54.113816 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.113818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.114781 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.114783 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.115621 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.115625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.116112 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.116113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.116173 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.116776 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:54.116783 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:54.118520 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:54.120704 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.120706 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.120707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.120978 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.121204 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.121205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.121205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.121282 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.121644 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:54.121645 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:54.121701 (+ 56us) client_negotiation.cc:769] Sending connection context
0620 15:00:54.121783 (+ 82us) client_negotiation.cc:240] Negotiation successful
0620 15:00:54.121925 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260620 15:00:54.122040 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.113226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53910 (local address 127.12.116.188:45983)
0620 15:00:54.113410 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.113412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.113420 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:54.113442 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.113443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.113452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.113499 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.113909 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.114677 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.115732 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.116036 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.116115 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.118666 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.118668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.118669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.118676 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.120545 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.121074 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.121076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.121076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.121141 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.121351 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.121352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.121353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.121546 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.121614 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.121809 (+ 195us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.121925 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161}
I20260620 15:00:54.123612 2652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: Bootstrap starting.
I20260620 15:00:54.124547 2652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:54.124905 2652 log.cc:824] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:54.125778 2652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: No bootstrap required, opened a new log
I20260620 15:00:54.127450 2652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.127619 2652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170c2c850c8c4759ac79fbd02ed278b3, State: Initialized, Role: FOLLOWER
I20260620 15:00:54.127722 2652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.128072 2748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.128187 2652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:54.128177 2748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: This master's current role is: FOLLOWER
W20260620 15:00:54.130312 2759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:54.130400 2759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:54.130612 2584 master_runner.cc:186] Error getting master registration for 127.12.116.190:44991: OK, instance_id { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" instance_seqno: 1781967653684480 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 15:00:54.133400 2584 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 15:00:54.140152 2577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } attempt: 3
Jun 20 15:00:54 dist-test-slave-7v06 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967653, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 15:00:54.151153 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.140587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:45983 (local address 127.0.0.1:53922)
0620 15:00:54.140649 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:54.140661 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:54.140705 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:54.140933 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:54.140935 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:54.141248 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:54.141320 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.141323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.142335 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.142336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.143166 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:54.143168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.143715 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.143716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:54.143792 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.144425 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:54.144431 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:54.146271 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:54.149573 (+ 3302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.149575 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.149575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.149918 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.150280 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:54.150281 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:54.150281 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:54.150354 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:54.150800 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:54.150801 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:54.150855 (+ 54us) client_negotiation.cc:769] Sending connection context
0620 15:00:54.150904 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 15:00:54.151027 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260620 15:00:54.151798 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.140663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.12.116.188:45983)
0620 15:00:54.140792 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.140794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.140803 (+ 9us) server_negotiation.cc:407] Connection header received
0620 15:00:54.140831 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.140833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.140844 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.140900 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.141442 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.142227 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.143283 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.143626 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.143697 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.146429 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.146431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.146432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.146443 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.149381 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.150063 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.150064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.150065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.150154 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.150438 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.150438 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.150439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.150683 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.151428 (+ 745us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.151499 (+ 71us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.151637 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260620 15:00:54.153911 2577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8: Bootstrap starting.
I20260620 15:00:54.154809 2577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:54.155160 2577 log.cc:824] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:54.156190 2577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8: No bootstrap required, opened a new log
I20260620 15:00:54.157775 2577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.157961 2577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ef2bc6aabd472e93fab579627135b8, State: Initialized, Role: FOLLOWER
I20260620 15:00:54.158056 2577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.158432 2577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:54.158414 2762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.158649 2762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:54.158463 2551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 15:00:54.159938 2551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:54.160990 2551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.161684 2626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95ef2bc6aabd472e93fab579627135b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "170c2c850c8c4759ac79fbd02ed278b3"
I20260620 15:00:54.161827 2626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:54.162850 2626 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ef2bc6aabd472e93fab579627135b8 in term 1.
I20260620 15:00:54.163407 2525 leader_election.cc:302] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170c2c850c8c4759ac79fbd02ed278b3, 95ef2bc6aabd472e93fab579627135b8; no voters:
I20260620 15:00:54.163641 2762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:54.163653 2702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95ef2bc6aabd472e93fab579627135b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e40872e77d94447f96f2b644164f717c"
I20260620 15:00:54.163774 2702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:54.163828 2762 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [term 1 LEADER]: Becoming Leader. State: Replica: 95ef2bc6aabd472e93fab579627135b8, State: Running, Role: LEADER
I20260620 15:00:54.163923 2762 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } }
I20260620 15:00:54.164417 2762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95ef2bc6aabd472e93fab579627135b8. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.164490 2762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:54.164757 2702 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ef2bc6aabd472e93fab579627135b8 in term 1.
I20260620 15:00:54.164992 2551 leader_election.cc:288] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [CANDIDATE]: Term 1 election: Requested vote from peers 170c2c850c8c4759ac79fbd02ed278b3 (127.12.116.189:44931), e40872e77d94447f96f2b644164f717c (127.12.116.188:45983)
I20260620 15:00:54.168501 2776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:54.168682 2509 master_runner.cc:263] No leader master found from master 95ef2bc6aabd472e93fab579627135b8
I20260620 15:00:54.168751 2509 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 15:00:54.169206 2776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:54.179682 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.169000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53936 (local address 127.12.116.188:45983)
0620 15:00:54.169045 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.169047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.170917 (+ 1870us) server_negotiation.cc:407] Connection header received
0620 15:00:54.171019 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.171020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.171031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.171062 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.171893 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.172693 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.173852 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.174162 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.174207 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.176074 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.176076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.176076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.176085 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.178133 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.178666 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.178668 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.178669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.178740 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.178968 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.178969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.178969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.179129 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.179211 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.179455 (+ 244us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.179573 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 15:00:54.180784 2626 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [term 1 FOLLOWER]: Refusing update from remote peer 95ef2bc6aabd472e93fab579627135b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:54.181142 2702 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [term 1 FOLLOWER]: Refusing update from remote peer 95ef2bc6aabd472e93fab579627135b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:54.181264 2774 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:54.181466 2762 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 15:00:54.183223 2530 tablet.cc:2369] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:54.183398 2748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95ef2bc6aabd472e93fab579627135b8. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.183514 2748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:54.183715 2734 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95ef2bc6aabd472e93fab579627135b8. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.183813 2734 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:54.185320 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.166577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58648 (local address 127.12.116.189:44931)
0620 15:00:54.166651 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.166653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.169334 (+ 2681us) server_negotiation.cc:407] Connection header received
0620 15:00:54.169443 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.169444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.169456 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.169488 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.170407 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.171184 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.176230 (+ 5046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.176583 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.176635 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.178824 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.178826 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.178827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.178835 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.180803 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.184361 (+ 3558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.184363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.184363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.184435 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.184665 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.184666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.184666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.184818 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.184902 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.185116 (+ 214us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.185220 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 15:00:54.194000 2774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.194144 2774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:54.194207 2784 mvcc.cc:205] Tried to move back new op lower bound from 7298939511505346560 to 7298939511456174080. Current Snapshot: MvccSnapshot[applied={T|T < 7298939511505346560}]
I20260620 15:00:54.194887 2786 mvcc.cc:205] Tried to move back new op lower bound from 7298939511505346560 to 7298939511456174080. Current Snapshot: MvccSnapshot[applied={T|T < 7298939511505346560}]
I20260620 15:00:54.194999 2748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.195096 2748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:54.195518 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:54.172604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37474 (local address 127.12.116.190:44991)
0620 15:00:54.172656 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.172658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.178620 (+ 5962us) server_negotiation.cc:407] Connection header received
0620 15:00:54.186537 (+ 7917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.186540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.186566 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.186598 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.187382 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.188261 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.189413 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:54.189722 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:54.189768 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:54.191558 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:54.191560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:54.191561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:54.191569 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:54.193532 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.194532 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.194533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.194534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.194603 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:54.194847 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:54.194848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:54.194849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:54.195002 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:54.195094 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:54.195340 (+ 246us) server_negotiation.cc:299] Negotiation successful
0620 15:00:54.195428 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 15:00:54.196547 2762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.196681 2762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:54.197307 2787 mvcc.cc:205] Tried to move back new op lower bound from 7298939511505346560 to 7298939511456174080. Current Snapshot: MvccSnapshot[applied={T|T < 7298939511505346560}]
I20260620 15:00:54.197412 2734 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95ef2bc6aabd472e93fab579627135b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ef2bc6aabd472e93fab579627135b8" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 44991 } } peers { permanent_uuid: "170c2c850c8c4759ac79fbd02ed278b3" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 44931 } } peers { permanent_uuid: "e40872e77d94447f96f2b644164f717c" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 45983 } } }
I20260620 15:00:54.197499 2734 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:54.200301 2776 catalog_manager.cc:1347] Generated new cluster ID: d4d2f027ee0440119c4646e525b304bf
I20260620 15:00:54.200445 2776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:54.219285 2776 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:54.220180 2776 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:54.227129 2776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95ef2bc6aabd472e93fab579627135b8: Generated new TSK 0
I20260620 15:00:54.227435 2776 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 15:00:54.262967 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.261185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37482 (local address 127.12.116.190:44991)
0620 15:00:54.261231 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.261233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.262022 (+ 789us) server_negotiation.cc:407] Connection header received
0620 15:00:54.262270 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.262272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.262286 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.262319 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.262879 (+ 560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37482: BlockingRecv error: recv got EOF from 127.0.0.1:37482 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260620 15:00:54.263953 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.260928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58654 (local address 127.12.116.189:44931)
0620 15:00:54.260983 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.260985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.262207 (+ 1222us) server_negotiation.cc:407] Connection header received
0620 15:00:54.263372 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.263391 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.263405 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.263439 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.263880 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58654: BlockingRecv error: recv got EOF from 127.0.0.1:58654 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260620 15:00:54.264925 2732 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.261617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53940 (local address 127.12.116.188:45983)
0620 15:00:54.261661 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.261663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.263252 (+ 1589us) server_negotiation.cc:407] Connection header received
0620 15:00:54.264246 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.264248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.264262 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.264296 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.264849 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53940: BlockingRecv error: recv got EOF from 127.0.0.1:53940 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260620 15:00:54.268604 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.267016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58662 (local address 127.12.116.189:44931)
0620 15:00:54.267062 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.267065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.267586 (+ 521us) server_negotiation.cc:407] Connection header received
0620 15:00:54.267796 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.267798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.267831 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.267869 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.268508 (+ 639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58662: BlockingRecv error: recv got EOF from 127.0.0.1:58662 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260620 15:00:54.273566 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.271849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58678 (local address 127.12.116.189:44931)
0620 15:00:54.271901 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.271903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.272414 (+ 511us) server_negotiation.cc:407] Connection header received
0620 15:00:54.272541 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.272544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.272559 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.272592 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.273492 (+ 900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58678: BlockingRecv error: recv got EOF from 127.0.0.1:58678 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260620 15:00:54.278247 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.277194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58686 (local address 127.12.116.189:44931)
0620 15:00:54.277243 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.277246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.277525 (+ 279us) server_negotiation.cc:407] Connection header received
0620 15:00:54.277644 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.277646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.277658 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.277691 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.278179 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58686: BlockingRecv error: recv got EOF from 127.0.0.1:58686 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260620 15:00:54.285014 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.283925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58698 (local address 127.12.116.189:44931)
0620 15:00:54.283976 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.283979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.284270 (+ 291us) server_negotiation.cc:407] Connection header received
0620 15:00:54.284431 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.284432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.284445 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.284477 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.284947 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58698: BlockingRecv error: recv got EOF from 127.0.0.1:58698 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260620 15:00:54.296240 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.295146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58704 (local address 127.12.116.189:44931)
0620 15:00:54.295201 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.295203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.295532 (+ 329us) server_negotiation.cc:407] Connection header received
0620 15:00:54.295648 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.295650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.295664 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.295698 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.296170 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58704: BlockingRecv error: recv got EOF from 127.0.0.1:58704 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260620 15:00:54.314996 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.313939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58708 (local address 127.12.116.189:44931)
0620 15:00:54.313992 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.313994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.314271 (+ 277us) server_negotiation.cc:407] Connection header received
0620 15:00:54.314395 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.314396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.314409 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.314442 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.314922 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58708: BlockingRecv error: recv got EOF from 127.0.0.1:58708 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260620 15:00:54.350677 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.349733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58712 (local address 127.12.116.189:44931)
0620 15:00:54.349783 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.349786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.350083 (+ 297us) server_negotiation.cc:407] Connection header received
0620 15:00:54.350157 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.350157 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.350170 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.350246 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.350608 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58712: BlockingRecv error: recv got EOF from 127.0.0.1:58712 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260620 15:00:54.417506 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.416236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58716 (local address 127.12.116.189:44931)
0620 15:00:54.416360 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.416362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.416604 (+ 242us) server_negotiation.cc:407] Connection header received
0620 15:00:54.416645 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.416646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.416659 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.416752 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.417424 (+ 672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58716: BlockingRecv error: recv got EOF from 127.0.0.1:58716 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260620 15:00:54.548107 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.547188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58728 (local address 127.12.116.189:44931)
0620 15:00:54.547322 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.547325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.547421 (+ 96us) server_negotiation.cc:407] Connection header received
0620 15:00:54.547528 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.547529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.547543 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.547651 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.548026 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58728: BlockingRecv error: recv got EOF from 127.0.0.1:58728 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260620 15:00:54.807233 2656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:54.806453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58736 (local address 127.12.116.189:44931)
0620 15:00:54.806541 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:54.806544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:54.806557 (+ 13us) server_negotiation.cc:407] Connection header received
0620 15:00:54.806593 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:54.806595 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:54.806613 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:54.806721 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:54.807131 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58736: BlockingRecv error: recv got EOF from 127.0.0.1:58736 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260620 15:00:55.117765 2745 catalog_manager.cc:1259] Loaded cluster ID: d4d2f027ee0440119c4646e525b304bf
I20260620 15:00:55.117859 2745 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: loading cluster ID for follower catalog manager: success
I20260620 15:00:55.118794 2745 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: acquiring CA information for follower catalog manager: success
I20260620 15:00:55.119370 2745 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e40872e77d94447f96f2b644164f717c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 15:00:55.130887 2759 catalog_manager.cc:1259] Loaded cluster ID: d4d2f027ee0440119c4646e525b304bf
I20260620 15:00:55.131006 2759 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: loading cluster ID for follower catalog manager: success
I20260620 15:00:55.132071 2759 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: acquiring CA information for follower catalog manager: success
I20260620 15:00:55.132517 2759 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 170c2c850c8c4759ac79fbd02ed278b3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 15:00:55.324097 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:55.321124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58748 (local address 127.12.116.189:44931)
0620 15:00:55.321308 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:55.321311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:55.321419 (+ 108us) server_negotiation.cc:407] Connection header received
0620 15:00:55.321527 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:55.321528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:55.321607 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:55.321714 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:55.321882 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.322405 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.323256 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.323470 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.323548 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:55.323725 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:55.323848 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:55.323936 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:55.323960 (+ 24us) server_negotiation.cc:299] Negotiation successful
0620 15:00:55.323988 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260620 15:00:55.330454 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:55.327132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.12.116.188:45983)
0620 15:00:55.327303 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:55.327305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:55.327328 (+ 23us) server_negotiation.cc:407] Connection header received
0620 15:00:55.327386 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:55.327387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:55.327443 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:55.327746 (+ 303us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:55.327915 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.328527 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.329590 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.329846 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.329907 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:55.330077 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:55.330199 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:55.330273 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:55.330347 (+ 74us) server_negotiation.cc:299] Negotiation successful
0620 15:00:55.330372 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":110,"threads_started":1}
I20260620 15:00:55.335410 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:55.332514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58762 (local address 127.12.116.189:44931)
0620 15:00:55.332560 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:55.332563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:55.332583 (+ 20us) server_negotiation.cc:407] Connection header received
0620 15:00:55.332616 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:55.332617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:55.332627 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:55.332708 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:55.332917 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.333640 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.334601 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.334817 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.334895 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:55.335043 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:55.335083 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:55.335134 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:55.335250 (+ 116us) server_negotiation.cc:299] Negotiation successful
0620 15:00:55.335293 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 15:00:55.336001 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:55.332774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53952 (local address 127.12.116.188:45983)
0620 15:00:55.332845 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:55.332847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:55.332897 (+ 50us) server_negotiation.cc:407] Connection header received
0620 15:00:55.332978 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:55.332979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:55.332989 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:55.333041 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:55.333229 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.333781 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.334821 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.335174 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.335240 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:55.335706 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:55.335745 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:55.335775 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:55.335871 (+ 96us) server_negotiation.cc:299] Negotiation successful
0620 15:00:55.335899 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 15:00:55.336212 2872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:55.332511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.12.116.190:44991)
0620 15:00:55.332789 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:55.332792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:55.332801 (+ 9us) server_negotiation.cc:407] Connection header received
0620 15:00:55.332883 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:55.332885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:55.332957 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:55.333053 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:55.333360 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.334088 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.335112 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:55.335406 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:55.335482 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:55.335706 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:55.335829 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:55.335896 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:55.336078 (+ 182us) server_negotiation.cc:299] Negotiation successful
0620 15:00:55.336111 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":50,"threads_started":1}
I20260620 15:00:55.338248 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2509
I20260620 15:00:55.345407 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2584
I20260620 15:00:55.351828 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2659
2026-06-20T15:00:55Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3057 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 15:00:55 dist-test-slave-7v06 krb5kdc[2876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 15:00:55 dist-test-slave-7v06 krb5kdc[2876](info): set up 2 sockets
Jun 20 15:00:55 dist-test-slave-7v06 krb5kdc[2876](info): commencing operation
krb5kdc: starting...
W20260620 15:00:56.465329 12754 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/test-user.keytab.
Jun 20 15:00:56 dist-test-slave-7v06 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T15:00:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T15:00:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.116.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
Entry for principal kudu/127.12.116.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab.
I20260620 15:00:56.612742 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:35007
--webserver_interface=127.12.116.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:35007,127.12.116.189:39959,127.12.116.188:33919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 15:00:56.703605 2889 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 15:00:56.703915 2889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:56.703949 2889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:56.703998 2889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:56.705504 2889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:56.705596 2889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:56.705622 2889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:56.705646 2889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:56.705674 2889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:56.707376 2889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:35007,127.12.116.189:39959,127.12.116.188:33919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.190.keytab
--principal=kudu/127.12.116.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.190:35007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.116.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:56.707705 2889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:56.707960 2889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:56.713785 2897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:56.713784 2894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:56.714004 2895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:56.714720 2889 server_base.cc:1034] running on GCE node
I20260620 15:00:56.715026 2889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:56.715404 2889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:56.716687 2889 hybrid_clock.cc:648] HybridClock initialized: now 1781967656716645 us; error 44 us; skew 500 ppm
Jun 20 15:00:56 dist-test-slave-7v06 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:56.720896 2889 init.cc:377] Logged in from keytab as kudu/127.12.116.190@KRBTEST.COM (short username kudu)
I20260620 15:00:56.721714 2889 webserver.cc:460] Webserver started at http://127.12.116.190:41351/ using document root <none> and password file <none>
I20260620 15:00:56.722020 2889 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:56.722107 2889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:56.722286 2889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:56.723557 2889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data/instance:
uuid: "5c222f39c6c246008c4790fb1389e4c9"
format_stamp: "Formatted at 2026-06-20 15:00:56 on dist-test-slave-7v06"
server_key: "0926a761739e1d74cd5b80973c236c5a"
server_key_iv: "8450af671706273dae2f33305a66fe1d"
server_key_version: "encryptionkey@0"
I20260620 15:00:56.724011 2889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal/instance:
uuid: "5c222f39c6c246008c4790fb1389e4c9"
format_stamp: "Formatted at 2026-06-20 15:00:56 on dist-test-slave-7v06"
server_key: "0926a761739e1d74cd5b80973c236c5a"
server_key_iv: "8450af671706273dae2f33305a66fe1d"
server_key_version: "encryptionkey@0"
I20260620 15:00:56.726562 2889 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:56.727934 2904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:56.728569 2889 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260620 15:00:56.728776 2889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal
uuid: "5c222f39c6c246008c4790fb1389e4c9"
format_stamp: "Formatted at 2026-06-20 15:00:56 on dist-test-slave-7v06"
server_key: "0926a761739e1d74cd5b80973c236c5a"
server_key_iv: "8450af671706273dae2f33305a66fe1d"
server_key_version: "encryptionkey@0"
I20260620 15:00:56.728912 2889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:56.761313 2889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:56.764532 2889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:56.764739 2889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:56.770329 2889 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.190:35007
I20260620 15:00:56.770409 2956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.190:35007 every 8 connection(s)
I20260620 15:00:56.770944 2889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/data/info.pb
I20260620 15:00:56.772080 2957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:56.774111 2957 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:56.780514 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2889
I20260620 15:00:56.780669 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-0/wal/instance
I20260620 15:00:56.780901 12754 external_mini_cluster.cc:1428] Setting key 230c8d4b59b4375ee771aabd16094670
Jun 20 15:00:56 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:56.786443 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.775005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34800 (local address 127.12.116.190:35007)
0620 15:00:56.775294 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:56.775304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:56.775445 (+ 141us) server_negotiation.cc:407] Connection header received
0620 15:00:56.776083 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:56.776086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:56.776104 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:56.776206 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:56.776882 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.777748 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.778707 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.779047 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.779186 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:56.782281 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:56.782289 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:56.782290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:56.782300 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:56.784445 (+ 2145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:56.785040 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:56.785043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:56.785044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:56.785159 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:56.785407 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:56.785408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:56.785409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:56.785670 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:56.785768 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:56.785984 (+ 216us) server_negotiation.cc:299] Negotiation successful
0620 15:00:56.786152 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":130,"threads_started":1}
I20260620 15:00:56.786443 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.774909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:35007 (local address 127.0.0.1:34800)
0620 15:00:56.775280 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.775332 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:56.775892 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:56.776212 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:56.776214 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:56.776592 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:56.776761 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:56.776766 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.777861 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.777862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:56.778587 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:56.778589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.779141 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.779142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:56.779207 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:56.779929 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:56.779939 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:56.782151 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:56.784573 (+ 2422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:56.784581 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:56.784584 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:56.784928 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:56.785242 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:56.785243 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:56.785243 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:56.785340 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:56.785754 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:56.785760 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:56.785830 (+ 70us) client_negotiation.cc:769] Sending connection context
0620 15:00:56.785945 (+ 115us) client_negotiation.cc:240] Negotiation successful
0620 15:00:56.786215 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":101,"thread_start_us":159,"threads_started":1}
I20260620 15:00:56.787823 2957 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:56.788321 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.788134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60892)
0620 15:00:56.788204 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.788276 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260620 15:00:56.788610 2905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.116.189@KRBTEST.COM; defaulting to no policy
I20260620 15:00:56.789176 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.789029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60894)
0620 15:00:56.789089 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.789127 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260620 15:00:56.789556 2957 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:39959: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab.
Entry for principal kudu/127.12.116.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab.
I20260620 15:00:56.812505 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:39959
--webserver_interface=127.12.116.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab
--principal=kudu/127.12.116.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:35007,127.12.116.189:39959,127.12.116.188:33919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 15:00:56.838977 2957 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } attempt: 1
I20260620 15:00:56.839682 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.839391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60896)
0620 15:00:56.839473 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.839529 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260620 15:00:56.840351 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.840207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60898)
0620 15:00:56.840264 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.840303 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260620 15:00:56.840556 2957 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:39959: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
W20260620 15:00:56.903748 2964 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 15:00:56.904028 2964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:56.904050 2964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:56.904083 2964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:56.905550 2964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:56.905619 2964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:56.905635 2964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:56.905648 2964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:56.905661 2964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:56.908912 2957 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } attempt: 2
I20260620 15:00:56.909827 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.909553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60914)
0620 15:00:56.909745 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.909792 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260620 15:00:56.910255 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.910152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60928)
0620 15:00:56.910201 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.910231 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260620 15:00:56.910770 2957 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.189:39959: Network error: Client connection negotiation failed: client connection to 127.12.116.189:39959: connect: Connection refused (error 111)
I20260620 15:00:56.910995 2964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:35007,127.12.116.189:39959,127.12.116.188:33919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.189.keytab
--principal=kudu/127.12.116.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.189:39959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.116.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:56.911345 2964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:56.911607 2964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:56.917807 2969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:56.917732 2970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:56.917835 2964 server_base.cc:1034] running on GCE node
W20260620 15:00:56.917737 2972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:56.918366 2964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:56.918781 2964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:56.920030 2964 hybrid_clock.cc:648] HybridClock initialized: now 1781967656919963 us; error 85 us; skew 500 ppm
Jun 20 15:00:56 dist-test-slave-7v06 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:56.923836 2964 init.cc:377] Logged in from keytab as kudu/127.12.116.189@KRBTEST.COM (short username kudu)
I20260620 15:00:56.924476 2964 webserver.cc:460] Webserver started at http://127.12.116.189:36571/ using document root <none> and password file <none>
I20260620 15:00:56.924765 2964 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:56.924819 2964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:56.924968 2964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:56.926237 2964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data/instance:
uuid: "d40307ce76bb4ca39e8b054fc3fd0196"
format_stamp: "Formatted at 2026-06-20 15:00:56 on dist-test-slave-7v06"
server_key: "0e0008548133506e7afe3784389d57e9"
server_key_iv: "b7393729d2d20e4b732f951c80f36368"
server_key_version: "encryptionkey@0"
I20260620 15:00:56.926666 2964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal/instance:
uuid: "d40307ce76bb4ca39e8b054fc3fd0196"
format_stamp: "Formatted at 2026-06-20 15:00:56 on dist-test-slave-7v06"
server_key: "0e0008548133506e7afe3784389d57e9"
server_key_iv: "b7393729d2d20e4b732f951c80f36368"
server_key_version: "encryptionkey@0"
I20260620 15:00:56.928737 2964 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260620 15:00:56.929908 2979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:56.930258 2964 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 15:00:56.930357 2964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal
uuid: "d40307ce76bb4ca39e8b054fc3fd0196"
format_stamp: "Formatted at 2026-06-20 15:00:56 on dist-test-slave-7v06"
server_key: "0e0008548133506e7afe3784389d57e9"
server_key_iv: "b7393729d2d20e4b732f951c80f36368"
server_key_version: "encryptionkey@0"
I20260620 15:00:56.930480 2964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:56.956173 2964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:56.960918 2964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:56.961373 2964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:56.965996 2964 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.189:39959
I20260620 15:00:56.966043 3031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.189:39959 every 8 connection(s)
I20260620 15:00:56.966464 2964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/data/info.pb
I20260620 15:00:56.967841 3032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:56.969203 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 2964
I20260620 15:00:56.969327 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-1/wal/instance
I20260620 15:00:56.969558 12754 external_mini_cluster.cc:1428] Setting key 242a227eab197a4450d41dae12b77dc3
I20260620 15:00:56.970623 3032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.116.188@KRBTEST.COM; defaulting to no policy
Jun 20 15:00:56 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.116.188@KRBTEST.COM" created.
I20260620 15:00:56.984925 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.972455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34810 (local address 127.12.116.190:35007)
0620 15:00:56.972569 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:56.972571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:56.972918 (+ 347us) server_negotiation.cc:407] Connection header received
0620 15:00:56.973655 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:56.973657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:56.973677 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:56.973728 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:56.974565 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.975141 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.977057 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.977388 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.977511 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:56.981010 (+ 3499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:56.981013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:56.981014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:56.981024 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:56.983174 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:56.983768 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:56.983770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:56.983771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:56.983829 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:56.984125 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:56.984126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:56.984126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:56.984269 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:56.984378 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:56.984713 (+ 335us) server_negotiation.cc:299] Negotiation successful
0620 15:00:56.984821 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260620 15:00:56.985168 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.972468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:35007 (local address 127.0.0.1:34810)
0620 15:00:56.972738 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.972799 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:56.973525 (+ 726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:56.973829 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:56.973834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:56.974227 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:56.974462 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:56.974466 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.975266 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.975268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:56.976862 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:56.976868 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.977555 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.977556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:56.977742 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:56.978600 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:56.978613 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:56.980788 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:56.983311 (+ 2523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:56.983329 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:56.983332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:56.983659 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:56.983905 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:56.983905 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:56.983906 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:56.984042 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:56.984371 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:56.984380 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:56.984555 (+ 175us) client_negotiation.cc:769] Sending connection context
0620 15:00:56.984680 (+ 125us) client_negotiation.cc:240] Negotiation successful
0620 15:00:56.984893 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":139,"threads_started":1}
I20260620 15:00:56.985920 3032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 15:00:56 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 15:00:56.997773 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.986267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60934)
0620 15:00:56.986330 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.986342 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:56.986393 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:56.986669 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:56.986670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:56.986840 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:56.986897 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:56.986899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.987836 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.987837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:56.988584 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:56.988588 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.989196 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.989197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:56.989267 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:56.989807 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:56.989812 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:56.991520 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:56.995868 (+ 4348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:56.995870 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:56.995871 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:56.996111 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:56.996645 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:56.996648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:56.996648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:56.996808 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:56.997310 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:56.997311 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:56.997355 (+ 44us) client_negotiation.cc:769] Sending connection context
0620 15:00:56.997452 (+ 97us) client_negotiation.cc:240] Negotiation successful
0620 15:00:56.997630 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260620 15:00:56.997807 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.986313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.12.116.189:39959)
0620 15:00:56.986517 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:56.986527 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:56.986546 (+ 19us) server_negotiation.cc:407] Connection header received
0620 15:00:56.986564 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:56.986565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:56.986577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:56.986669 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:56.986986 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.987733 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.988710 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:56.989091 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:56.989196 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:56.992143 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:56.992167 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:56.992168 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:56.992180 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:56.995656 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:56.996228 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:56.996233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:56.996234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:56.996315 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:56.996902 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:56.996903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:56.996903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:56.997189 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:56.997348 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:56.997491 (+ 143us) server_negotiation.cc:299] Negotiation successful
0620 15:00:56.997700 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":116,"server-negotiator.queue_time_us":172,"thread_start_us":115,"threads_started":1}
I20260620 15:00:56.999059 3032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:56.999910 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:56.999679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:44992)
0620 15:00:56.999798 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:56.999875 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260620 15:00:57.000193 2981 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
I20260620 15:00:57.001138 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.000866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45006)
0620 15:00:57.001028 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.001077 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260620 15:00:57.001415 3032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:33919: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
I20260620 15:00:57.001989 2957 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.116.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab.
Entry for principal kudu/127.12.116.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab.
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 15:00:57.007892 12754 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeVrfqy/build/release/bin/kudu
/tmp/dist-test-taskeVrfqy/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:33919
--webserver_interface=127.12.116.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab
--principal=kudu/127.12.116.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.116.148:42963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.116.190:35007,127.12.116.189:39959,127.12.116.188:33919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 15:00:57.011351 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.002436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60942)
0620 15:00:57.002547 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.002563 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:57.002645 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:57.002786 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:57.002787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:57.003007 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:57.003142 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.003146 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.004292 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.004294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.004999 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.005003 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.005539 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.005541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.005684 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.006388 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:57.006393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:57.008056 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:57.010084 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.010086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.010087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.010294 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.010617 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.010618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.010618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.010694 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.010976 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:57.010977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:57.011033 (+ 56us) client_negotiation.cc:769] Sending connection context
0620 15:00:57.011121 (+ 88us) client_negotiation.cc:240] Negotiation successful
0620 15:00:57.011241 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260620 15:00:57.011351 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.002548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60942 (local address 127.12.116.189:39959)
0620 15:00:57.002655 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.002657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.002671 (+ 14us) server_negotiation.cc:407] Connection header received
0620 15:00:57.002704 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.002705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.002719 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.002780 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.003298 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.004035 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.005140 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.005408 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.005482 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.008220 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.008222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.008222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.008232 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.009967 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.010376 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.010377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.010377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.010533 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.010763 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.010764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.010765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.010898 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.010975 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.011147 (+ 172us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.011241 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260620 15:00:57.011777 2957 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:57.012189 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.012066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45022)
0620 15:00:57.012127 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.012156 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260620 15:00:57.012720 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.012549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45034)
0620 15:00:57.012663 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.012697 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260620 15:00:57.012879 2957 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:33919: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
I20260620 15:00:57.044090 2957 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } attempt: 1
I20260620 15:00:57.044689 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.044513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45046)
0620 15:00:57.044593 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.044649 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260620 15:00:57.045149 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.045047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45058)
0620 15:00:57.045093 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.045125 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260620 15:00:57.045306 2957 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:33919: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
I20260620 15:00:57.050796 3032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } attempt: 1
I20260620 15:00:57.051728 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.051528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45060)
0620 15:00:57.051623 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.051677 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260620 15:00:57.052440 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.052212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45072)
0620 15:00:57.052306 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.052414 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260620 15:00:57.052579 3032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:33919: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
W20260620 15:00:57.103259 3039 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 15:00:57.103684 3039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 15:00:57.103724 3039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 15:00:57.103780 3039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 15:00:57.105530 3039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 15:00:57.105686 3039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 15:00:57.105716 3039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 15:00:57.105758 3039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 15:00:57.105787 3039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 15:00:57.107683 3039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.116.148:42963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.116.190:35007,127.12.116.189:39959,127.12.116.188:33919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/krb5kdc/kudu_127.12.116.188.keytab
--principal=kudu/127.12.116.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.116.188:33919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.116.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 13:54:59 UTC on ccycloud.quasar-mqrrzv.root.comops.site
build id 4457505
I20260620 15:00:57.108029 3039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 15:00:57.108301 3039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 15:00:57.113979 3045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:57.114060 3039 server_base.cc:1034] running on GCE node
W20260620 15:00:57.113994 3047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 15:00:57.114006 3044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 15:00:57.114444 3039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 15:00:57.114746 3039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 15:00:57.116008 3039 hybrid_clock.cc:648] HybridClock initialized: now 1781967657115952 us; error 45 us; skew 500 ppm
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967657, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 15:00:57.120455 3039 init.cc:377] Logged in from keytab as kudu/127.12.116.188@KRBTEST.COM (short username kudu)
I20260620 15:00:57.120428 2957 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } attempt: 2
I20260620 15:00:57.120777 3032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } attempt: 2
I20260620 15:00:57.121022 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.120872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45080)
0620 15:00:57.120947 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.120981 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260620 15:00:57.121255 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.121064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45088)
0620 15:00:57.121173 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.121212 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260620 15:00:57.121308 3039 webserver.cc:460] Webserver started at http://127.12.116.188:45689/ using document root <none> and password file <none>
I20260620 15:00:57.121487 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.121390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45098)
0620 15:00:57.121433 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.121463 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260620 15:00:57.121812 3039 fs_manager.cc:359] Metadata directory not provided
I20260620 15:00:57.121941 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.121812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45108)
0620 15:00:57.121881 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.121909 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260620 15:00:57.121768 2957 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:33919: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
W20260620 15:00:57.122049 3032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.116.188:33919: Network error: Client connection negotiation failed: client connection to 127.12.116.188:33919: connect: Connection refused (error 111)
I20260620 15:00:57.122026 3039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 15:00:57.122223 3039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 15:00:57.123770 3039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data/instance:
uuid: "b4905496cdf042d491bbe6a62f3766cd"
format_stamp: "Formatted at 2026-06-20 15:00:57 on dist-test-slave-7v06"
server_key: "3abe28e18dfe40f0760dc3586c39a7bb"
server_key_iv: "c34602e0b1aa8433475288350bf1f7d7"
server_key_version: "encryptionkey@0"
I20260620 15:00:57.124132 3039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal/instance:
uuid: "b4905496cdf042d491bbe6a62f3766cd"
format_stamp: "Formatted at 2026-06-20 15:00:57 on dist-test-slave-7v06"
server_key: "3abe28e18dfe40f0760dc3586c39a7bb"
server_key_iv: "c34602e0b1aa8433475288350bf1f7d7"
server_key_version: "encryptionkey@0"
I20260620 15:00:57.126667 3039 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260620 15:00:57.129118 3054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 15:00:57.129709 3039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260620 15:00:57.129885 3039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data,/tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal
uuid: "b4905496cdf042d491bbe6a62f3766cd"
format_stamp: "Formatted at 2026-06-20 15:00:57 on dist-test-slave-7v06"
server_key: "3abe28e18dfe40f0760dc3586c39a7bb"
server_key_iv: "c34602e0b1aa8433475288350bf1f7d7"
server_key_version: "encryptionkey@0"
I20260620 15:00:57.130016 3039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 15:00:57.149477 3039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 15:00:57.153252 3039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 15:00:57.153436 3039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 15:00:57.160060 3039 rpc_server.cc:307] RPC server started. Bound to: 127.12.116.188:33919
I20260620 15:00:57.160094 3106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.116.188:33919 every 8 connection(s)
I20260620 15:00:57.160594 3039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/data/info.pb
I20260620 15:00:57.161631 3107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 15:00:57.163399 3107 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } has no permanent_uuid. Determining permanent_uuid...
I20260620 15:00:57.164443 12754 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeVrfqy/build/release/bin/kudu as pid 3039
I20260620 15:00:57.164583 12754 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeVrfqy/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781967351633327-12754-0/minicluster-data/master-2/wal/instance
I20260620 15:00:57.164806 12754 external_mini_cluster.cc:1428] Setting key 109402cba7d46ada5c27e97246138d91
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967657, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 15:00:57.174865 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.164372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.12.116.190:35007)
0620 15:00:57.164434 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.164436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.164687 (+ 251us) server_negotiation.cc:407] Connection header received
0620 15:00:57.165651 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.165652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.165663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.165723 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.166355 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.166883 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.168232 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.168553 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.168636 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.171082 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.171084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.171084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.171092 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.172897 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.173686 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.173687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.173687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.173749 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.174036 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.174037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.174037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.174195 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.174278 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.174668 (+ 390us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.174765 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 15:00:57.175143 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.164296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.190:35007 (local address 127.0.0.1:34822)
0620 15:00:57.164515 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.164563 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:57.165378 (+ 815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:57.165743 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:57.165749 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:57.166094 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:57.166259 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.166263 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.166979 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.166980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.168108 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.168110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.168658 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.168659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.168788 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.169429 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:57.169440 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:57.170931 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:57.173237 (+ 2306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.173248 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.173252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.173601 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.173820 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.173822 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.173822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.173963 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.174301 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:57.174308 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:57.174504 (+ 196us) client_negotiation.cc:769] Sending connection context
0620 15:00:57.174625 (+ 121us) client_negotiation.cc:240] Negotiation successful
0620 15:00:57.174818 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":130,"threads_started":1}
I20260620 15:00:57.175619 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.165247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45122 (local address 127.12.116.188:33919)
0620 15:00:57.165418 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.165423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.165611 (+ 188us) server_negotiation.cc:407] Connection header received
0620 15:00:57.165700 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.165702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.165727 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.165817 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.166619 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.167934 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.168963 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.169423 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.169506 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.172152 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.172164 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.172164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.172173 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.174077 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.174478 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.174481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.174482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.174546 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.174813 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.174814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.174814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.174984 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.175151 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.175243 (+ 92us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.175513 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260620 15:00:57.176007 3107 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967657, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.190@KRBTEST.COM
I20260620 15:00:57.185585 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.176401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60948 (local address 127.12.116.189:39959)
0620 15:00:57.176455 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.176458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.176511 (+ 53us) server_negotiation.cc:407] Connection header received
0620 15:00:57.176584 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.176585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.176594 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.176670 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.177002 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.177575 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.178243 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.178470 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.178565 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.181163 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.181165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.181165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.181177 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.183245 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.184147 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.184148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.184148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.184220 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.184964 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.184965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.184966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.185121 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.185221 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.185397 (+ 176us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.185480 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 15:00:57.185585 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.176348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.189:39959 (local address 127.0.0.1:60948)
0620 15:00:57.176445 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.176456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:57.176526 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:57.176765 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:57.176765 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:57.176881 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:57.176936 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.176938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.177653 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.177654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.178150 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.178151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.178566 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.178566 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.178644 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.179150 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:57.179156 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:57.180974 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:57.183578 (+ 2604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.183579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.183580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.183943 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.184778 (+ 835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.184780 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.184781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.184857 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.185214 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:57.185215 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:57.185269 (+ 54us) client_negotiation.cc:769] Sending connection context
0620 15:00:57.185356 (+ 87us) client_negotiation.cc:240] Negotiation successful
0620 15:00:57.185480 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260620 15:00:57.186054 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.176716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34824 (local address 127.12.116.190:35007)
0620 15:00:57.176750 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.176754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.177066 (+ 312us) server_negotiation.cc:407] Connection header received
0620 15:00:57.177089 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.177090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.177100 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.177162 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.177596 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.178061 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.178806 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.179000 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.179076 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.182050 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.182053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.182053 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.182063 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.184582 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.184948 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.184949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.184950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.185025 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.185249 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.185250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.185251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.185372 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.185582 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.185620 (+ 38us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.185952 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 15:00:57.186046 3107 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967657, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.188@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.116.189@KRBTEST.COM
I20260620 15:00:57.194380 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.186383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45136)
0620 15:00:57.186481 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.186491 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:57.186547 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:57.186690 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:57.186691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:57.186853 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:57.186909 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.186911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.187813 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.187814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.188580 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.188582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.189119 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.189121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.189167 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.189668 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:57.189673 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:57.191169 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:57.193250 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.193251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.193251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.193451 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.193693 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.193694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.193694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.193758 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.194068 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:57.194069 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:57.194114 (+ 45us) client_negotiation.cc:769] Sending connection context
0620 15:00:57.194191 (+ 77us) client_negotiation.cc:240] Negotiation successful
0620 15:00:57.194304 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260620 15:00:57.194526 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.186415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45136 (local address 127.12.116.188:33919)
0620 15:00:57.186459 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.186461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.186549 (+ 88us) server_negotiation.cc:407] Connection header received
0620 15:00:57.186602 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.186603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.186617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.186673 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.186988 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.187733 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.188652 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.188984 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.189076 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.191264 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.191266 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.191266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.191275 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.193157 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.193543 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.193544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.193545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.193602 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.193828 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.193829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.193830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.193974 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.194050 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.194238 (+ 188us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.194360 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":18}
I20260620 15:00:57.195688 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.186842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60954 (local address 127.12.116.189:39959)
0620 15:00:57.186883 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.186885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.186894 (+ 9us) server_negotiation.cc:407] Connection header received
0620 15:00:57.186918 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.186919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.186928 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.186986 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.187588 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.188287 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.189336 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.189606 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.189686 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.192485 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.192487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.192487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.192496 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.194363 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.194905 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.194906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.194906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.194965 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.195198 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.195199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.195199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.195341 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.195471 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.195542 (+ 71us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.195605 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 15:00:57.196429 3107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: Bootstrap starting.
I20260620 15:00:57.197122 12754 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 15:00:57.197520 3107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:57.197878 3107 log.cc:824] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:57.198907 3107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: No bootstrap required, opened a new log
I20260620 15:00:57.198354 2931 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5c222f39c6c246008c4790fb1389e4c9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34824
I20260620 15:00:57.200645 3107 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.200795 3107 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4905496cdf042d491bbe6a62f3766cd, State: Initialized, Role: FOLLOWER
I20260620 15:00:57.200893 3107 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.201284 3107 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:57.201272 3113 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.201404 3113 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: This master's current role is: FOLLOWER
W20260620 15:00:57.203317 3124 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:57.203404 3124 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:57.203939 3039 master_runner.cc:186] Error getting master registration for 127.12.116.190:35007: OK, instance_id { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" instance_seqno: 1781967656768157 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 15:00:57.207260 3039 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 15:00:57.213202 3032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } attempt: 3
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.189@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 15:00:57.221184 2957 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } attempt: 3
I20260620 15:00:57.222496 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.213618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45146)
0620 15:00:57.213730 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.213750 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:57.213824 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:57.214058 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:57.214059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:57.214288 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:57.214349 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.214351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.215350 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.215351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.216165 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.216167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.216747 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.216749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.216814 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.217296 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:57.217302 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:57.218975 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:57.221095 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.221097 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.221097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.221375 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.221615 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.221615 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.221616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.221683 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.222076 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:57.222077 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:57.222168 (+ 91us) client_negotiation.cc:769] Sending connection context
0620 15:00:57.222247 (+ 79us) client_negotiation.cc:240] Negotiation successful
0620 15:00:57.222378 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260620 15:00:57.222496 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.213797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45146 (local address 127.12.116.188:33919)
0620 15:00:57.213888 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.213891 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.213903 (+ 12us) server_negotiation.cc:407] Connection header received
0620 15:00:57.213935 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.213936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.213948 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.214023 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.214466 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.215246 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.216264 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.216597 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.216679 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.219085 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.219087 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.219088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.219098 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.220954 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.221470 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.221472 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.221472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.221541 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.221747 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.221748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.221749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.221990 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.222073 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.222297 (+ 224us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.222394 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260620 15:00:57.224720 3032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: Bootstrap starting.
I20260620 15:00:57.225629 3032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:57.225998 3032 log.cc:824] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: Log is configured to *not* fsync() on all Append() calls
Jun 20 15:00:57 dist-test-slave-7v06 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781967656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.116.190@KRBTEST.COM for kudu/127.12.116.188@KRBTEST.COM
I20260620 15:00:57.227010 3032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: No bootstrap required, opened a new log
I20260620 15:00:57.229415 3032 raft_consensus.cc:348] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.229612 3032 raft_consensus.cc:729] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d40307ce76bb4ca39e8b054fc3fd0196, State: Initialized, Role: FOLLOWER
I20260620 15:00:57.229705 3032 consensus_queue.cc:260] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.230139 3032 sys_catalog.cc:564] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:57.230118 3128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.230501 3128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:57.230897 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.221509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.116.188:33919 (local address 127.0.0.1:45158)
0620 15:00:57.221570 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 15:00:57.221581 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 15:00:57.221626 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 15:00:57.221961 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 15:00:57.221963 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 15:00:57.222177 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0620 15:00:57.222237 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.222240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.223561 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.223562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.224126 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 15:00:57.224128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.224711 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.224712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 15:00:57.224777 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.225296 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 15:00:57.225302 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 15:00:57.226951 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 15:00:57.229457 (+ 2506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.229459 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.229460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.229750 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.230069 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 15:00:57.230070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 15:00:57.230071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 15:00:57.230157 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 15:00:57.230502 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 15:00:57.230503 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 15:00:57.230562 (+ 59us) client_negotiation.cc:769] Sending connection context
0620 15:00:57.230618 (+ 56us) client_negotiation.cc:240] Negotiation successful
0620 15:00:57.230751 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260620 15:00:57.231455 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.221574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45158 (local address 127.12.116.188:33919)
0620 15:00:57.221841 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.221843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.221851 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:57.221874 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.221875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.221886 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.221952 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.222613 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.223477 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.224230 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.224641 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.224712 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.227083 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.227085 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.227085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.227121 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.229312 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.229861 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.229863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.229864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.229977 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.230248 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.230249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.230249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.230415 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.231128 (+ 713us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.231190 (+ 62us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.231317 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":191,"threads_started":1}
W20260620 15:00:57.232849 3139 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:57.233021 3139 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:57.233330 2957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: Bootstrap starting.
I20260620 15:00:57.234197 2957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: Neither blocks nor log segments found. Creating new log.
I20260620 15:00:57.234527 2957 log.cc:824] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: Log is configured to *not* fsync() on all Append() calls
I20260620 15:00:57.232360 2964 master_runner.cc:186] Error getting master registration for 127.12.116.190:35007: OK, instance_id { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" instance_seqno: 1781967656768157 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 15:00:57.235616 2957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: No bootstrap required, opened a new log
I20260620 15:00:57.235682 2964 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 15:00:57.237021 2957 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.237182 2957 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c222f39c6c246008c4790fb1389e4c9, State: Initialized, Role: FOLLOWER
I20260620 15:00:57.237282 2957 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.237663 2957 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 15:00:57.237684 2931 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 15:00:57.237731 2931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:57.238770 2931 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.239094 2931 leader_election.cc:288] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [CANDIDATE]: Term 1 election: Requested vote from peers d40307ce76bb4ca39e8b054fc3fd0196 (127.12.116.189:39959), b4905496cdf042d491bbe6a62f3766cd (127.12.116.188:33919)
I20260620 15:00:57.239905 3072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c222f39c6c246008c4790fb1389e4c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b4905496cdf042d491bbe6a62f3766cd"
I20260620 15:00:57.239907 3006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c222f39c6c246008c4790fb1389e4c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d40307ce76bb4ca39e8b054fc3fd0196"
I20260620 15:00:57.240083 3006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:57.240083 3072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [term 0 FOLLOWER]: Advancing to term 1
I20260620 15:00:57.241103 3006 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c222f39c6c246008c4790fb1389e4c9 in term 1.
I20260620 15:00:57.241114 3072 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c222f39c6c246008c4790fb1389e4c9 in term 1.
I20260620 15:00:57.241822 2905 leader_election.cc:302] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c222f39c6c246008c4790fb1389e4c9, d40307ce76bb4ca39e8b054fc3fd0196; no voters:
I20260620 15:00:57.237609 3142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.242467 3142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:57.242564 3142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 15:00:57.242650 3142 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [term 1 LEADER]: Becoming Leader. State: Replica: 5c222f39c6c246008c4790fb1389e4c9, State: Running, Role: LEADER
I20260620 15:00:57.242762 3142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } }
I20260620 15:00:57.243350 3142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c222f39c6c246008c4790fb1389e4c9. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.243474 3142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: This master's current role is: LEADER
W20260620 15:00:57.244774 3153 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 15:00:57.244846 3153 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 15:00:57.245438 2889 master_runner.cc:263] No leader master found from master 5c222f39c6c246008c4790fb1389e4c9
I20260620 15:00:57.245532 2889 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 15:00:57.261443 3160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 15:00:57.261705 3160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 15:00:57.262773 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.248750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60960 (local address 127.12.116.189:39959)
0620 15:00:57.248809 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.248811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.249175 (+ 364us) server_negotiation.cc:407] Connection header received
0620 15:00:57.249307 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.249308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.249321 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.249359 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.250355 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.251177 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.252447 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.252769 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.252819 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.255790 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.255792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.255792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.255803 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.257773 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.261523 (+ 3750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.261525 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.261526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.261640 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.262045 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.262046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.262046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.262206 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.262315 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.262550 (+ 235us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.262669 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260620 15:00:57.265727 2910 tablet.cc:2369] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 15:00:57.273608 3072 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [term 1 FOLLOWER]: Refusing update from remote peer 5c222f39c6c246008c4790fb1389e4c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:57.273989 3158 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:57.275630 3113 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c222f39c6c246008c4790fb1389e4c9. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.275748 3113 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:57.276197 3006 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [term 1 FOLLOWER]: Refusing update from remote peer 5c222f39c6c246008c4790fb1389e4c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 15:00:57.276520 3158 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 15:00:57.277297 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.248738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45160 (local address 127.12.116.188:33919)
0620 15:00:57.248799 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.248802 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.254875 (+ 6073us) server_negotiation.cc:407] Connection header received
0620 15:00:57.254993 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.254994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.255011 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.255048 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.258639 (+ 3591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.259464 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.266135 (+ 6671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.266496 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.266549 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.270872 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.270874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.270874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.270884 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.272755 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.273204 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.273205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.273206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.273270 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.276154 (+ 2884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.276156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.276157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.276350 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.276449 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.277086 (+ 637us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.277195 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 15:00:57.278059 3128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c222f39c6c246008c4790fb1389e4c9. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.278158 3128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:57.279175 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:57.249043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.12.116.190:35007)
0620 15:00:57.249088 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.249091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.258500 (+ 9409us) server_negotiation.cc:407] Connection header received
0620 15:00:57.259592 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.259594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.259611 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.259659 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.264039 (+ 4380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.264880 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.268826 (+ 3946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:57.269236 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:57.269284 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:57.273371 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 15:00:57.273373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 15:00:57.273373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 15:00:57.273382 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 15:00:57.275399 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.276777 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.276779 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.276779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.276845 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 15:00:57.278506 (+ 1661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 15:00:57.278507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 15:00:57.278508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 15:00:57.278698 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 15:00:57.278787 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:57.278992 (+ 205us) server_negotiation.cc:299] Negotiation successful
0620 15:00:57.279076 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 15:00:57.279554 3142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.279659 3142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:57.279667 3128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.279763 3128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:57.279800 3165 mvcc.cc:205] Tried to move back new op lower bound from 7298939524189274112 to 7298939524067512320. Current Snapshot: MvccSnapshot[applied={T|T < 7298939524189274112}]
I20260620 15:00:57.280025 3168 mvcc.cc:205] Tried to move back new op lower bound from 7298939524189274112 to 7298939524067512320. Current Snapshot: MvccSnapshot[applied={T|T < 7298939524189274112}]
I20260620 15:00:57.285005 3160 catalog_manager.cc:1347] Generated new cluster ID: 0726c70602a44be2b5ac07c772a35cfb
I20260620 15:00:57.285104 3160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 15:00:57.289288 3158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.289417 3158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9 [sys.catalog]: This master's current role is: LEADER
I20260620 15:00:57.289999 3113 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c222f39c6c246008c4790fb1389e4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c222f39c6c246008c4790fb1389e4c9" member_type: VOTER last_known_addr { host: "127.12.116.190" port: 35007 } } peers { permanent_uuid: "d40307ce76bb4ca39e8b054fc3fd0196" member_type: VOTER last_known_addr { host: "127.12.116.189" port: 39959 } } peers { permanent_uuid: "b4905496cdf042d491bbe6a62f3766cd" member_type: VOTER last_known_addr { host: "127.12.116.188" port: 33919 } } }
I20260620 15:00:57.290143 3113 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd [sys.catalog]: This master's current role is: FOLLOWER
I20260620 15:00:57.290586 3166 mvcc.cc:205] Tried to move back new op lower bound from 7298939524189274112 to 7298939524067512320. Current Snapshot: MvccSnapshot[applied={T|T < 7298939524189274112}]
I20260620 15:00:57.300400 3160 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 15:00:57.301218 3160 catalog_manager.cc:1504] Loading token signing keys...
I20260620 15:00:57.308699 3160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c222f39c6c246008c4790fb1389e4c9: Generated new TSK 0
I20260620 15:00:57.308943 3160 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 15:00:57.340795 2960 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.339133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34844 (local address 127.12.116.190:35007)
0620 15:00:57.339185 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.339188 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.339942 (+ 754us) server_negotiation.cc:407] Connection header received
0620 15:00:57.340088 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.340090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.340104 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.340140 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.340715 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34844: BlockingRecv error: recv got EOF from 127.0.0.1:34844 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260620 15:00:57.341651 3126 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.339624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45164 (local address 127.12.116.188:33919)
0620 15:00:57.339674 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.339676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.341078 (+ 1402us) server_negotiation.cc:407] Connection header received
0620 15:00:57.341182 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.341183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.341195 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.341227 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.341576 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45164: BlockingRecv error: recv got EOF from 127.0.0.1:45164 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260620 15:00:57.342728 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.342028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60968 (local address 127.12.116.189:39959)
0620 15:00:57.342069 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.342071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.342196 (+ 125us) server_negotiation.cc:407] Connection header received
0620 15:00:57.342289 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.342290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.342300 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.342330 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.342667 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60968: BlockingRecv error: recv got EOF from 127.0.0.1:60968 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260620 15:00:57.345305 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.344461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60978 (local address 127.12.116.189:39959)
0620 15:00:57.344501 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.344503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.344719 (+ 216us) server_negotiation.cc:407] Connection header received
0620 15:00:57.344832 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.344833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.344852 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.344884 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.345249 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60978: BlockingRecv error: recv got EOF from 127.0.0.1:60978 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260620 15:00:57.348737 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.347777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60994 (local address 127.12.116.189:39959)
0620 15:00:57.347818 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.347820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.348067 (+ 247us) server_negotiation.cc:407] Connection header received
0620 15:00:57.348176 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.348177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.348189 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.348220 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.348677 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60994: BlockingRecv error: recv got EOF from 127.0.0.1:60994 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260620 15:00:57.353260 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.352208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32774 (local address 127.12.116.189:39959)
0620 15:00:57.352257 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.352260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.352620 (+ 360us) server_negotiation.cc:407] Connection header received
0620 15:00:57.352741 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.352742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.352755 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.352786 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.353196 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32774: BlockingRecv error: recv got EOF from 127.0.0.1:32774 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260620 15:00:57.359793 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.358779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32776 (local address 127.12.116.189:39959)
0620 15:00:57.358827 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.358829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.359112 (+ 283us) server_negotiation.cc:407] Connection header received
0620 15:00:57.359228 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.359229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.359245 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.359277 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.359725 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32776: BlockingRecv error: recv got EOF from 127.0.0.1:32776 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260620 15:00:57.370451 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.369478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32780 (local address 127.12.116.189:39959)
0620 15:00:57.369531 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.369534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.369816 (+ 282us) server_negotiation.cc:407] Connection header received
0620 15:00:57.369924 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.369926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.369938 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.369969 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.370385 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32780: BlockingRecv error: recv got EOF from 127.0.0.1:32780 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260620 15:00:57.389464 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.388116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32786 (local address 127.12.116.189:39959)
0620 15:00:57.388171 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.388173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.388511 (+ 338us) server_negotiation.cc:407] Connection header received
0620 15:00:57.388744 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.388746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.388768 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.388821 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.389395 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32786: BlockingRecv error: recv got EOF from 127.0.0.1:32786 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260620 15:00:57.424134 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.423111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32798 (local address 127.12.116.189:39959)
0620 15:00:57.423168 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.423171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.423314 (+ 143us) server_negotiation.cc:407] Connection header received
0620 15:00:57.423405 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.423406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.423419 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.423501 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.424041 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32798: BlockingRecv error: recv got EOF from 127.0.0.1:32798 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260620 15:00:57.490648 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.489489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.12.116.189:39959)
0620 15:00:57.489651 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.489655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.489817 (+ 162us) server_negotiation.cc:407] Connection header received
0620 15:00:57.489969 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.489971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.489990 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.490054 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.490545 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32802: BlockingRecv error: recv got EOF from 127.0.0.1:32802 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
W20260620 15:00:57.621150 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.620186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32810 (local address 127.12.116.189:39959)
0620 15:00:57.620287 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.620289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.620384 (+ 95us) server_negotiation.cc:407] Connection header received
0620 15:00:57.620520 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.620521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.620535 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.620654 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.621051 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32810: BlockingRecv error: recv got EOF from 127.0.0.1:32810 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260620 15:00:57.879516 3037 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 15:00:57.878879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32826 (local address 127.12.116.189:39959)
0620 15:00:57.878954 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:57.878958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:57.878970 (+ 12us) server_negotiation.cc:407] Connection header received
0620 15:00:57.878995 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:57.878996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:57.879005 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:57.879073 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 15:00:57.879441 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32826: BlockingRecv error: recv got EOF from 127.0.0.1:32826 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260620 15:00:58.204085 3124 catalog_manager.cc:1259] Loaded cluster ID: 0726c70602a44be2b5ac07c772a35cfb
I20260620 15:00:58.204237 3124 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: loading cluster ID for follower catalog manager: success
I20260620 15:00:58.205305 3124 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: acquiring CA information for follower catalog manager: success
I20260620 15:00:58.205682 3124 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b4905496cdf042d491bbe6a62f3766cd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 15:00:58.233629 3139 catalog_manager.cc:1259] Loaded cluster ID: 0726c70602a44be2b5ac07c772a35cfb
I20260620 15:00:58.233740 3139 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: loading cluster ID for follower catalog manager: success
I20260620 15:00:58.234822 3139 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: acquiring CA information for follower catalog manager: success
I20260620 15:00:58.235227 3139 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d40307ce76bb4ca39e8b054fc3fd0196: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 15:00:58.396168 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:58.393090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32842 (local address 127.12.116.189:39959)
0620 15:00:58.393210 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:58.393212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:58.393225 (+ 13us) server_negotiation.cc:407] Connection header received
0620 15:00:58.393254 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:58.393254 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:58.393310 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:58.393408 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:58.393670 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.394228 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.395116 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.395333 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.395405 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:58.395679 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:58.395831 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:58.395910 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:58.396056 (+ 146us) server_negotiation.cc:299] Negotiation successful
0620 15:00:58.396082 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
I20260620 15:00:58.401976 3243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:58.398549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.12.116.188:33919)
0620 15:00:58.398692 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:58.398695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:58.398703 (+ 8us) server_negotiation.cc:407] Connection header received
0620 15:00:58.398776 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:58.398777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:58.398843 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:58.398925 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:58.399072 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.399615 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.400627 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.400898 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.401014 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:58.401279 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:58.401490 (+ 211us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:58.401598 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:58.401786 (+ 188us) server_negotiation.cc:299] Negotiation successful
0620 15:00:58.401850 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260620 15:00:58.408380 3243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:58.405107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.12.116.188:33919)
0620 15:00:58.405150 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:58.405152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:58.405257 (+ 105us) server_negotiation.cc:407] Connection header received
0620 15:00:58.405338 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:58.405339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:58.405356 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:58.405432 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:58.405635 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.406250 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.407188 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.407507 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.407601 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:58.407853 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:58.407909 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:58.407991 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:58.408153 (+ 162us) server_negotiation.cc:299] Negotiation successful
0620 15:00:58.408193 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 15:00:58.409665 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:58.404983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32858 (local address 127.12.116.189:39959)
0620 15:00:58.405052 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:58.405055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:58.405394 (+ 339us) server_negotiation.cc:407] Connection header received
0620 15:00:58.405452 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:58.405453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:58.405466 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:58.405543 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:58.405780 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.406781 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.408380 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.408886 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.408956 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:58.409397 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:58.409440 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:58.409504 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:58.409572 (+ 68us) server_negotiation.cc:299] Negotiation successful
0620 15:00:58.409604 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 15:00:58.409662 3249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 15:00:58.404935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34850 (local address 127.12.116.190:35007)
0620 15:00:58.405066 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0620 15:00:58.405068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 15:00:58.405281 (+ 213us) server_negotiation.cc:407] Connection header received
0620 15:00:58.405362 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 15:00:58.405363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 15:00:58.405425 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 15:00:58.405697 (+ 272us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 15:00:58.405831 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.406816 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.408285 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 15:00:58.408646 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 15:00:58.408724 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 15:00:58.409168 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 15:00:58.409374 (+ 206us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 15:00:58.409457 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 15:00:58.409517 (+ 60us) server_negotiation.cc:299] Negotiation successful
0620 15:00:58.409556 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260620 15:00:58.411903 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2889
I20260620 15:00:58.418087 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 2964
I20260620 15:00:58.424508 12754 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeVrfqy/build/release/bin/kudu with pid 3039
2026-06-20T15:00:58Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3074 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6132 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (306800 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST